Showing 297 open source projects for "data collect"

View related business solutions
  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New customers can spin up VMs, build with AI, and query data at no cost.

    Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
    Start Free
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Start Free
  • 1
    Polymarket Data

    Polymarket Data

    Polymarket Data Retriever that fetches, processes, and structures data

    Polymarket Data is a comprehensive data engineering pipeline designed to collect, process, and structure trading activity from the Polymarket prediction market ecosystem into analyzable datasets. The system operates as a multi-stage pipeline that integrates data from both off-chain APIs and on-chain event sources, enabling users to reconstruct full trading activity including markets, order events, and executed trades.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    ThingsBoard

    ThingsBoard

    Device management, data collection, processing and visualization

    ...Define relations between your devices, assets, customers or any other entities. Collect and store telemetry data in a scalable and fault-tolerant way. Visualize your data with built-in or custom widgets and flexible dashboards. Share dashboards with your customers. Define data processing rule chains. Transform and normalize your device data. Raise alarms on incoming telemetry events, attribute updates, device inactivity, and user actions.
    Downloads: 63 This Week
    Last Update:
    See Project
  • 3
    OpenFlow

    OpenFlow

    Scalable, secure workflow solution

    Collect, transport, store and report on events and data from humans, IT systems and the physical world.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 4
    Telegram-OSINT

    Telegram-OSINT

    https://github.com/The-Osint-Toolbox/Telegram-OSINT

    ...In addition to direct data collection tools, it provides resources for channel discovery, similar channel analysis, and browser-based interfaces for interacting with Telegram data.
    Downloads: 40 This Week
    Last Update:
    See Project
  • Veeam Data Platform v13.1 - Get Your Free Trial Icon
    Veeam Data Platform v13.1 - Get Your Free Trial

    Secure by design, portable by default. Recover clean, fast, anywhere. Start a free trial.

    Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
    Try it Free
  • 5
    AWS IoT FleetWise Edge

    AWS IoT FleetWise Edge

    AWS IoT FleetWise Edge Agent

    Easily collect, transform, and transfer vehicle data to the cloud in near-real-time. AWS IoT FleetWise makes it easy and cost-effective for automakers to collect, transform, and transfer vehicle data to the cloud in near-real-time and use it to build applications with analytics and machine learning that improve vehicle quality, safety, and autonomy.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    douyin

    douyin

    Open source Douyin crawler for collecting and downloading public data

    DouyinCrawler is an open source data collection tool designed to gather publicly available information from the Douyin platform. It demonstrates how to build a Python-based web crawler combined with a graphical interface and command line functionality. It allows users to collect data from various types of Douyin content, including user profiles, videos, hashtags, and music pages.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    Weibo Crawler

    Weibo Crawler

    Python crawler for collecting and downloading Sina Weibo user data

    ...It also captures detailed data about each post, including the content, publishing time, topics, mentions, likes, reposts, and comments. In addition to textual data, the project can download original media from posts, such as images, videos, and Live Photo content. Collected data can be exported to structured formats such as CSV or JSON or stored in databases for further analysis and research.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 8
    Coverage.jl

    Coverage.jl

    Take Julia code coverage and memory allocation results, do useful thin

    Julia can track how many times, if any, each line of your code is run. This is useful for measuring how much of your code base your tests actually test, and can reveal the parts of your code that are not tested and might be hiding a bug. You can use Coverage.jl to summarize the results of this tracking or to send them to a service like Coveralls.io or Codecov.io. Julia can track how much memory is allocated by each line of your code. This can reveal problems like type instability, or...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    Jellyfin

    Jellyfin

    The Free Software Media System

    ...Jellyfin has no tracking, phone-home, or central servers collecting your data. We believe in keeping our software open and transparent, and anything we might collect (crash logs, etc.) is opt-in only. We’re also not in the media business, so the only media you see is your own.
    Downloads: 25 This Week
    Last Update:
    See Project
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Start Free
  • 10
    OpenTelemetry

    OpenTelemetry

    OpenTelemetry Go API and SDK

    OpenTelemetry-Go is the Go implementation of OpenTelemetry. It provides a set of APIs to directly measure the performance and behavior of your software and send this data to observability platforms. High-quality, ubiquitous, and portable telemetry to enable effective observability. OpenTelemetry is a collection of APIs, SDKs, and tools. Use it to instrument, generate, collect, and export telemetry data (metrics, logs, and traces) to help you analyze your software’s performance and behavior.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    ActivityWatch

    ActivityWatch

    Automatically tracks how you spend time on your devices

    ActivityWatch is app for tracking how you spend time on your devices that is open source, cross-platform and extensible. Focused on privacy, it is able to collect as much (or as little) valuable life data as the user prefers in a secure manner that doesn’t compromise user privacy, and gives the user complete control of the data. ActivityWatch can be used for many things: tracking time spent on different projects, managing bad screen habits, tracking productivity and more.
    Downloads: 17 This Week
    Last Update:
    See Project
  • 12
    Event Espresso Core

    Event Espresso Core

    Event Espresso 4 Core for WordPress: Build an Event Ticketing Website

    ...Event managers can control every aspect of their event–or automate it all–to make their event registration fit their situation, be successful and profitable. The key to giving customers a great experience is gathering information from them so you are prepared. Easily collect all the data you need with a custom event registration form on your event registration website. Want more people at your events? Make it easy for one person to register multiple attendees or attendees at the same time during the same checkout.
    Downloads: 15 This Week
    Last Update:
    See Project
  • 13
    Splunk Attack Range

    Splunk Attack Range

    Tool to simulate attacks and collect the data

    Attack Range Log The Splunk Attack Range is an open-source project maintained by the Splunk Threat Research Team. It builds instrumented cloud (AWS, Azure) and local environments (Virtualbox), simulates attacks, and forwards the data into a Splunk instance. This environment can then be used to develop and test the effectiveness of detections.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 14
    Scanopy

    Scanopy

    Clean network diagrams, One-time setup, zero upkeep

    Scanopy is a powerful multi-modal data capture and analysis toolkit that enables users to collect, process, and visualize structured and unstructured information from a variety of sources in a flexible pipeline. It is built to handle complex scanning tasks — such as OCR, document analysis, audio transcription, network data capture, and image extraction — while providing unified APIs and workflows that make managing heterogeneous data sources seamless. ...
    Downloads: 10 This Week
    Last Update:
    See Project
  • 15
    QGIS

    QGIS

    Cross platform (lin/win/mac) geographical information system (GIS)

    ...It runs on Linux, Unix, Mac OSX, Windows and Android and supports numerous vector, raster, and database formats and functionalities. QGIS provides a continously growing number of capabilities provided by core functions and plugins. You can visualize, manage, edit, analyze data, and compose printable maps. We also collect case studies of how people all over the world use QGIS for their GIS work. You can view combinations of vector and raster data (in 2D or 3D) in different formats and projections without conversion to an internal or common format.
    Downloads: 281 This Week
    Last Update:
    See Project
  • 16
    X-osint

    X-osint

    Open source OSINT tool for gathering data on emails, phones, and IPs

    X-osint is an open source intelligence framework designed to collect and analyze publicly available information from multiple sources. It focuses on gathering useful and credible data about entities such as phone numbers, email addresses, and IP addresses using a range of automated OSINT techniques. It provides investigators and researchers with a centralized interface for running information-gathering tasks that would normally require multiple separate tools.
    Downloads: 575 This Week
    Last Update:
    See Project
  • 17
    Wiseflow

    Wiseflow

    Enhance any agent's browser use skill

    Wiseflow is an open-source information extraction and knowledge discovery system designed to collect, filter, and organize valuable information from large volumes of online content. The platform continuously monitors specified sources such as websites, social platforms, and other digital channels to identify relevant data according to user-defined interests or topics. By combining web crawling, content parsing, and large language model analysis, the system extracts concise insights from raw information streams and converts them into structured data that can be stored or analyzed. ...
    Downloads: 35 This Week
    Last Update:
    See Project
  • 18
    BongoCat

    BongoCat

    Cross-platform interactive table pet BongoCat, add fun to your desktop

    ...Users can import custom models to change the cat’s appearance and create personalized desktop companions. The application is built with Tauri, combining a Rust backend with a Vue and TypeScript interface. It works completely offline and states that it does not collect user data. The repository also links to model conversion tools, downloadable community models, release packages, and contribution guidance.
    Downloads: 200 This Week
    Last Update:
    See Project
  • 19
    Personal Management System

    Personal Management System

    Your web application for managing personal data

    It's easier to understand this web application when you think about a CMS (WordPress) or CRM (SugarCRM); the logic behind this system is very similar to those two. My PMS may offer fewer possibilities than those systems above, but it just does what I want it to do. Additionally, writing extensions is not too hard, depending on the logic required. Anyone with development knowledge can pretty much write their own extensions for personal needs. Keep a track of your personal goals. You can use...
    Downloads: 15 This Week
    Last Update:
    See Project
  • 20
    Argilla

    Argilla

    The open-source data curation platform for LLMs

    ...Argilla is free, open-source, and 100% compatible with major NLP libraries (Hugging Face transformers, spaCy, Stanford Stanza, Flair, etc.). In fact, you can use and combine your preferred libraries without implementing any specific interface. Most annotation tools treat data collection as a one-off activity at the beginning of each project. In real-world projects, data collection is a key activity of the iterative process of ML model development. Once a model goes into production, you want to monitor and analyze its predictions, and collect more data to improve your model over time. Argilla is designed to close this gap, enabling you to iterate as much as you need.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    rtlamr

    rtlamr

    An rtl-sdr receiver for Itron ERT compatible smart meters

    ...There's now experimental support for data collection and aggregation with rtlamr-collect.
    Downloads: 8 This Week
    Last Update:
    See Project
  • 22
    UnoPIM

    UnoPIM

    A free and open source Laravel-based PIM software to help businesses

    Unopim is an open-source Product Information Management (PIM) system designed to help businesses manage and centralize product data. It provides a structured way to collect, enrich, and distribute product information across multiple channels, improving data consistency and accuracy. Unopim is designed to streamline product data management for e-commerce, retail, and marketing applications, allowing for better data governance and more efficient updates.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 23
    MarkEdit

    MarkEdit

    Just like TextEdit on Mac but dedicated to Markdown

    MarkEdit is a free and open-source Markdown editor, for macOS. It's just like TextEdit on Mac but dedicated to Markdown.
    Downloads: 11 This Week
    Last Update:
    See Project
  • 24
    prompts.chat

    prompts.chat

    Share, discover, and collect prompts

    prompts.chat, also known as Awesome ChatGPT Prompts, is an open-source community project that curates high-quality prompt examples for modern AI chat models. The repository functions as a centralized library where users can browse, share, and collect prompt templates designed to improve the usefulness and creativity of AI interactions. Originally built around ChatGPT use cases, the prompts are broadly compatible with many contemporary large language models, making the resource flexible...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 25
    DouK-Downloader

    DouK-Downloader

    TikTok releases/likes/compilations/live streams/videos/atlases/music

    DouK-Downloader is a fully open-source data acquisition and media downloading tool designed to extract, collect, and download content from TikTok and its Chinese counterpart Douyin at scale. Built using Python and modern asynchronous networking libraries such as HTTPX, it enables batch downloading of videos, images, live streams, and metadata from accounts, playlists, and individual links.
    Downloads: 14 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • 2
  • 3
  • 4
  • 5
  • Next