Search Results for "data collect"
Sort By:
Showing 393 open source projects for "data collect"
View related business solutions-
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
1
Polymarket Data
Polymarket Data Retriever that fetches, processes, and structures data
Polymarket Data is a comprehensive data engineering pipeline designed to collect, process, and structure trading activity from the Polymarket prediction market ecosystem into analyzable datasets. The system operates as a multi-stage pipeline that integrates data from both off-chain APIs and on-chain event sources, enabling users to reconstruct full trading activity including markets, order events, and executed trades. -
2
ThingsBoard
Device management, data collection, processing and visualization
...Define relations between your devices, assets, customers or any other entities. Collect and store telemetry data in a scalable and fault-tolerant way. Visualize your data with built-in or custom widgets and flexible dashboards. Share dashboards with your customers. Define data processing rule chains. Transform and normalize your device data. Raise alarms on incoming telemetry events, attribute updates, device inactivity, and user actions. -
3
Telegram-OSINT
https://github.com/The-Osint-Toolbox/Telegram-OSINT
...In addition to direct data collection tools, it provides resources for channel discovery, similar channel analysis, and browser-based interfaces for interacting with Telegram data. -
4
OpenFlow
Scalable, secure workflow solution
Collect, transport, store and report on events and data from humans, IT systems and the physical world. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
AWS IoT FleetWise Edge
AWS IoT FleetWise Edge Agent
Easily collect, transform, and transfer vehicle data to the cloud in near-real-time. AWS IoT FleetWise makes it easy and cost-effective for automakers to collect, transform, and transfer vehicle data to the cloud in near-real-time and use it to build applications with analytics and machine learning that improve vehicle quality, safety, and autonomy. -
6
douyin
Open source Douyin crawler for collecting and downloading public data
DouyinCrawler is an open source data collection tool designed to gather publicly available information from the Douyin platform. It demonstrates how to build a Python-based web crawler combined with a graphical interface and command line functionality. It allows users to collect data from various types of Douyin content, including user profiles, videos, hashtags, and music pages. -
7
Weibo Crawler
Python crawler for collecting and downloading Sina Weibo user data
...It also captures detailed data about each post, including the content, publishing time, topics, mentions, likes, reposts, and comments. In addition to textual data, the project can download original media from posts, such as images, videos, and Live Photo content. Collected data can be exported to structured formats such as CSV or JSON or stored in databases for further analysis and research. -
8
Coverage.jl
Take Julia code coverage and memory allocation results, do useful thin
Julia can track how many times, if any, each line of your code is run. This is useful for measuring how much of your code base your tests actually test, and can reveal the parts of your code that are not tested and might be hiding a bug. You can use Coverage.jl to summarize the results of this tracking or to send them to a service like Coveralls.io or Codecov.io. Julia can track how much memory is allocated by each line of your code. This can reveal problems like type instability, or... -
9
Jellyfin
The Free Software Media System
...Jellyfin has no tracking, phone-home, or central servers collecting your data. We believe in keeping our software open and transparent, and anything we might collect (crash logs, etc.) is opt-in only. We’re also not in the media business, so the only media you see is your own. -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
10
OpenTelemetry
OpenTelemetry Go API and SDK
OpenTelemetry-Go is the Go implementation of OpenTelemetry. It provides a set of APIs to directly measure the performance and behavior of your software and send this data to observability platforms. High-quality, ubiquitous, and portable telemetry to enable effective observability. OpenTelemetry is a collection of APIs, SDKs, and tools. Use it to instrument, generate, collect, and export telemetry data (metrics, logs, and traces) to help you analyze your software’s performance and behavior. -
11
ActivityWatch
Automatically tracks how you spend time on your devices
ActivityWatch is app for tracking how you spend time on your devices that is open source, cross-platform and extensible. Focused on privacy, it is able to collect as much (or as little) valuable life data as the user prefers in a secure manner that doesn’t compromise user privacy, and gives the user complete control of the data. ActivityWatch can be used for many things: tracking time spent on different projects, managing bad screen habits, tracking productivity and more. -
12
Event Espresso Core
Event Espresso 4 Core for WordPress: Build an Event Ticketing Website
...Event managers can control every aspect of their event–or automate it all–to make their event registration fit their situation, be successful and profitable. The key to giving customers a great experience is gathering information from them so you are prepared. Easily collect all the data you need with a custom event registration form on your event registration website. Want more people at your events? Make it easy for one person to register multiple attendees or attendees at the same time during the same checkout. -
13
QGIS
Cross platform (lin/win/mac) geographical information system (GIS)
...It runs on Linux, Unix, Mac OSX, Windows and Android and supports numerous vector, raster, and database formats and functionalities. QGIS provides a continously growing number of capabilities provided by core functions and plugins. You can visualize, manage, edit, analyze data, and compose printable maps. We also collect case studies of how people all over the world use QGIS for their GIS work. You can view combinations of vector and raster data (in 2D or 3D) in different formats and projections without conversion to an internal or common format. -
14
Splunk Attack Range
Tool to simulate attacks and collect the data
Attack Range Log The Splunk Attack Range is an open-source project maintained by the Splunk Threat Research Team. It builds instrumented cloud (AWS, Azure) and local environments (Virtualbox), simulates attacks, and forwards the data into a Splunk instance. This environment can then be used to develop and test the effectiveness of detections. -
15
X-osint
Open source OSINT tool for gathering data on emails, phones, and IPs
X-osint is an open source intelligence framework designed to collect and analyze publicly available information from multiple sources. It focuses on gathering useful and credible data about entities such as phone numbers, email addresses, and IP addresses using a range of automated OSINT techniques. It provides investigators and researchers with a centralized interface for running information-gathering tasks that would normally require multiple separate tools. -
16
Scanopy
Clean network diagrams, One-time setup, zero upkeep
Scanopy is a powerful multi-modal data capture and analysis toolkit that enables users to collect, process, and visualize structured and unstructured information from a variety of sources in a flexible pipeline. It is built to handle complex scanning tasks — such as OCR, document analysis, audio transcription, network data capture, and image extraction — while providing unified APIs and workflows that make managing heterogeneous data sources seamless. ... -
17
BongoCat
Cross-platform interactive table pet BongoCat, add fun to your desktop
...Users can import custom models to change the cat’s appearance and create personalized desktop companions. The application is built with Tauri, combining a Rust backend with a Vue and TypeScript interface. It works completely offline and states that it does not collect user data. The repository also links to model conversion tools, downloadable community models, release packages, and contribution guidance. -
18
rtlamr
An rtl-sdr receiver for Itron ERT compatible smart meters
...There's now experimental support for data collection and aggregation with rtlamr-collect. -
19
Wiseflow
Enhance any agent's browser use skill
Wiseflow is an open-source information extraction and knowledge discovery system designed to collect, filter, and organize valuable information from large volumes of online content. The platform continuously monitors specified sources such as websites, social platforms, and other digital channels to identify relevant data according to user-defined interests or topics. By combining web crawling, content parsing, and large language model analysis, the system extracts concise insights from raw information streams and converts them into structured data that can be stored or analyzed. ... -
20
Personal Management System
Your web application for managing personal data
It's easier to understand this web application when you think about a CMS (WordPress) or CRM (SugarCRM); the logic behind this system is very similar to those two. My PMS may offer fewer possibilities than those systems above, but it just does what I want it to do. Additionally, writing extensions is not too hard, depending on the logic required. Anyone with development knowledge can pretty much write their own extensions for personal needs. Keep a track of your personal goals. You can use... -
21
Argilla
The open-source data curation platform for LLMs
...Argilla is free, open-source, and 100% compatible with major NLP libraries (Hugging Face transformers, spaCy, Stanford Stanza, Flair, etc.). In fact, you can use and combine your preferred libraries without implementing any specific interface. Most annotation tools treat data collection as a one-off activity at the beginning of each project. In real-world projects, data collection is a key activity of the iterative process of ML model development. Once a model goes into production, you want to monitor and analyze its predictions, and collect more data to improve your model over time. Argilla is designed to close this gap, enabling you to iterate as much as you need. -
22
MarkEdit
Just like TextEdit on Mac but dedicated to Markdown
MarkEdit is a free and open-source Markdown editor, for macOS. It's just like TextEdit on Mac but dedicated to Markdown. -
23
UnoPIM
A free and open source Laravel-based PIM software to help businesses
Unopim is an open-source Product Information Management (PIM) system designed to help businesses manage and centralize product data. It provides a structured way to collect, enrich, and distribute product information across multiple channels, improving data consistency and accuracy. Unopim is designed to streamline product data management for e-commerce, retail, and marketing applications, allowing for better data governance and more efficient updates. -
24
prompts.chat
Share, discover, and collect prompts
prompts.chat, also known as Awesome ChatGPT Prompts, is an open-source community project that curates high-quality prompt examples for modern AI chat models. The repository functions as a centralized library where users can browse, share, and collect prompt templates designed to improve the usefulness and creativity of AI interactions. Originally built around ChatGPT use cases, the prompts are broadly compatible with many contemporary large language models, making the resource flexible... -
25
gitcrawl
Local-first GitHub issue and pull request crawler
gitcrawl is a repository crawling and indexing tool associated with the OpenClaw ecosystem, designed to collect, organize, and analyze Git-based project data at scale. The project focuses on automating repository inspection and enabling structured access to source code, commit history, and metadata for research, automation, or AI-assisted workflows. Its architecture likely emphasizes efficient crawling, local indexing, and integration with other OpenClaw tooling for autonomous analysis and retrieval. ...
