Search Results for "data capture framework" - Page 38
Sort By:
Showing 2706 open source projects for "data capture framework"
View related business solutions-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
One Monitoring Tool for IT, OT and Cloud | Free TrialModern infrastructure spans data centers, cloud platforms and factory floors, and every blind spot between them is a risk. PRTG supports SNMP, WMI, SSH and other standard protocols to monitor IT, OT and hybrid environments through one customizable dashboard. Build the views your team needs, from network health to application performance, without switching tools. Try PRTG free for 30 days now.
-
1
spider_collection
Collection of Python web scraping scripts for data extraction tasks
spider_collection is a collection of Python web crawler scripts created primarily for experimentation, learning, and practical scraping tasks. spider_collection gathers multiple independent spiders designed to collect data from different platforms and services, demonstrating a variety of scraping techniques and workflows. These crawlers make use of common Python scraping tools such as requests, parsel, BeautifulSoup, and the Scrapy framework to extract structured information from web pages. Several scripts also incorporate multi-threading and proxy usage to improve scraping efficiency and help avoid common anti-scraping limitations. ... -
2
dude uncomplicated data extraction
dude uncomplicated data extraction: A simple framework
Dude is a very simple framework for writing web scrapers using Python decorators. The design, inspired by Flask, was to easily build a web scraper in just a few lines of code. Dude has an easy-to-learn syntax. Dude is currently in Pre-Alpha. Please expect breaking changes. You can run your scraper from terminal/shell/command-line by supplying URLs, the output filename of your choice and the paths to your python scripts to dude scrape command. -
3
Adeus
An open source AI wearable device that captures what you say
Adeus is an experimental open-source framework focused on building autonomous AI agents capable of reasoning, planning, and executing complex tasks with minimal human intervention. The project explores the concept of agent-based AI systems that can break down objectives into smaller steps, execute them sequentially, and adapt based on intermediate results. It provides a structured environment for orchestrating workflows that involve multiple actions, such as retrieving data, generating content, or interacting with external tools. ... -
4
Skeet
What...? Skeet is evolving to SLV
Skeet is an open source framework designed for building scalable serverless applications with Firebase, Google Cloud, and GraphQL. -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
5
Canopy
Retrieval Augmented Generation (RAG) framework
Canopy is an open-source retrieval-augmented generation (RAG) framework developed by Pinecone to simplify the process of building applications that combine large language models with external knowledge sources. The system provides a complete pipeline for transforming raw text data into searchable embeddings, storing them in a vector database, and retrieving relevant context for language model responses. -
6
TaskWeaver
A code-first agent framework for seamlessly planning analytics tasks
TaskWeaver is a multi-agent AI framework designed for orchestrating autonomous agents that collaborate to complete complex tasks. -
7
Vanilla JS Projects
Course with Vanilla JS Projects
JavaScript Basic Projects is a collection of small applications for practicing browser programming with vanilla JavaScript. The repository contains 29 projects that progress from simple interface interactions to larger applications using external data. Early exercises cover counters, navigation bars, modals, tabs, menus, sliders, and countdown timers. Later examples introduce object-oriented programming, filtering, pagination, dark mode, and dynamic product interfaces. API-oriented projects work with jokes, users, cocktails, Wikipedia content, and other remote data sources. Each project provides a focused environment for learning DOM manipulation, events, application state, and JavaScript logic without a front-end framework. ... -
8
Transformers in Time Series
A professionally curated list of awesome resources
...It compiles literature from major conferences and journals and categorizes them by application domains such as forecasting, anomaly detection, and classification. The repository also provides a taxonomy that helps researchers understand different architectural variations of transformers designed for time series data. These models are particularly important because transformers can capture long-range dependencies in sequential data, which makes them well suited for complex temporal patterns in real-world datasets. -
9
Evilginx 3.0
Standalone man-in-the-middle attack framework
Evilginx 3.0 is a standalone security-testing framework that demonstrates reverse-proxy phishing attacks against modern web authentication systems. It sits between a browser and a legitimate service to study how credentials and authenticated session data can be intercepted in adversary-in-the-middle scenarios. Because session tokens can remain valid after multifactor authentication, the project highlights limitations of some traditional 2FA deployments. -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
10
higgsfield
Fault-tolerant, highly scalable GPU orchestration
Higgsfield is an open-source, fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters, such as Large Language Models (LLMs). -
11
D3
Bring data to life with SVG, Canvas and HTML
D3.js is a JavaScript library for manipulating documents based on data. D3 helps you bring data to life using HTML, SVG, and CSS. D3’s emphasis on web standards gives you the full capabilities of modern browsers without tying yourself to a proprietary framework, combining powerful visualization components and a data-driven approach to DOM manipulation. D3 allows you to bind arbitrary data to a Document Object Model (DOM), and then apply data-driven transformations to the document. ... -
12
SendGrid C#
The Twilio SendGrid C# API Library
Leverage the email service that customer-first brands trust for reliable inbox delivery at scale. This library allows you to quickly and easily use the Twilio SendGrid Web API v3 via C#. Manage your Twilio SendGrid API Keys by storing them in Environment Variables or in Web. It is a good practice to keep your data and configuration settings separate. This way you can change your Twilio SendGrid API key without changing your code. Also, we strongly advise against storing sensitive data... -
13
Blazor Boilerplate
Blazor Boilerplate / Starter Template with MudBlazor
Blazor is a web framework designed to run in the browser on a WebAssembly-based .NET runtime. Blazor Boilerplate aka Blazor Starter Template is a SPA admin template that is able to run both WebAssembly (Core-Hosted) and Server-Side Blazor with a .NET Core 6.0 Server. The default mode for BB is Server Side. To switch to Webassembly log in as Admin and go to settings. -
14
LangChain Extract
Did you say you like data?
LangChain Extract is an open-source reference application designed to demonstrate how large language models can be used to extract structured data from unstructured text and document files. The project implements a lightweight web service that allows developers to define extraction schemas and apply them to various sources such as plain text, HTML, or PDF documents. Built using FastAPI and the LangChain framework, the application exposes a REST API that can process documents and return structured outputs that match user-defined JSON schemas. ... -
15
PhoneInfoga
Information gathering framework for phone numbers
PhoneInfoga is an open-source intelligence framework focused on gathering and analyzing information related to international phone numbers. The tool aggregates data from multiple scanners and external services to provide contextual intelligence such as country, carrier, line type, and potential VoIP provider details. It is designed primarily for investigators, analysts, and security researchers who need structured phone-number reconnaissance rather than real-time tracking. ... -
16
cerberuscms2
Cerberus Content Management System
Cerberus Content Management System is a dynamic, secure and infinitely expandable CMS designed after a Unix-Like model. It is a custom written Web Application Framework ( W.A.F. ) with a consistent and custom written Pre-Hyper-Text-Post-Processor Programming Code Framework ( P.C.F. ). This Web Application Software Project' aim is to be the fastest and most secure Web Application Framework, Web Application Programming Code Framework, Text, Voice and Video Communications Platform and Content Management System in the world. ... -
17
local-llm
Run LLMs locally on Cloud Workstations
local-llm is a development framework that enables developers to run large language models locally within Google Cloud Workstations or standard environments without requiring GPU hardware. It focuses on making generative AI development more accessible by leveraging quantized models and CPU-based execution, eliminating the dependency on expensive GPU infrastructure. -
18
Breakpad
Mirror of Google Breakpad project
Breakpad is an open source crash reporting system developed by Google that provides both client and server components to capture, analyze, and report software crashes across platforms. It is designed to help developers diagnose and fix crashes efficiently by generating detailed crash dumps, stack traces, and diagnostic data whenever an application fails unexpectedly. The framework includes libraries for embedding crash-handling functionality directly into applications and tools for processing and symbolizing crash dumps on the server side. ... -
19
EasyML
EasyML serialization library, to and from XML, similar to Gson
EasyML converts Java objects into XML and back again, without the need for annotations or other types of configuration. EasyML offers extensive support for JDK classes and also supports customization through user settings, user extensions, or through the Java Serialization API. EasyML provides support for: - reading and writing XML text and/or org.w3c.dom documents - Java Collections framework - Java Serialization framework - Multi-threading - Java Generics and functional... -
20
Featureform
Turn your existing data infrastructure into a feature store
Featureform allows data scientists to define, manage, and serve machine learning features across your organization. The days of untitled_128.ipynb are over. Transformations, features, and training sets can be pushed from notebooks to a centralized feature repository with metadata like name, variant, lineage, and owner. Featureform's Virtual Feature Store architecture orchestrates your data infrastructure to build and maintain your training sets and production features. ... -
21
dbt-re-data
re_data - fix data issues before your users & CEO would discover them
re_data is an open-source data reliability framework for the modern data stack. Currently, re_data focuses on observing the dbt project (together with underlaying data warehouse - Postgres, BigQuery, Snowflake, Redshift). Data transformations in re_data are implemented and exposed as models & macros in this dbt package. Gather all relevant outputs about your data in one place using our cloud. -
22
Statistical Rethinking 2024
This course teaches data analysis
The 2024 repository is the most recent version of the course, reflecting ongoing refinements in pedagogy, statistical modeling techniques, and coding practices. It provides updated notebooks, R scripts, and model examples, some streamlined and restructured compared to previous years. The 2024 repo also highlights the transition toward more robust Stan models and integration with newer Bayesian workflow practices, continuing to emphasize accessibility for learners while modernizing the tools.... -
23
VulcanSQL
Data API Framework for AI Agents and Data Apps
Vulcan SQL is a modern data API framework that lets you build secure and scalable data APIs directly from SQL files. Designed for data teams, it allows the definition of parameterized queries, policy enforcement, and transformation layers using familiar SQL syntax. Vulcan SQL integrates with BI tools and data warehouses, making it easy to expose internal datasets as RESTful APIs. -
24
Macro AutoPilot (Beta)
Guiding Your Workload, Effortlessy
Streamline and Boost Your Process, Discover how simple it is to automate monotonous jobs using both basic and sophisticated features in a single, user-friendly tool. You may easily customize criteria, sequences, and click intervals. Get more done right now with "Macro AutoPilot". -
25
ToRA
Tool-integrated Reasoning LLM Agents
...This approach allows the model to reason step by step in natural language and then execute precise calculations or code through tool calls, creating a hybrid reasoning workflow. The framework was designed to address known weaknesses of large language models in mathematical problem solving and formal reasoning tasks. Training data includes tool-use trajectories that teach the model when to reason verbally and when to delegate tasks to specialized tools.
