Showing 297 open source projects for "data collect"

View related business solutions
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Start Free
  • Train ML Models With SQL You Already Know Icon
    Train ML Models With SQL You Already Know

    BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

    Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
    Start Free
  • 1
    TRACARDI - Customer Data Platform

    TRACARDI - Customer Data Platform

    TRACARDI free open-source customer data platform

    TRACARDI is easy to use and free GUI for Apache Unomi. Unomi is an open source Customer Data Platform that allows anyone to collect user profiles and manage them in a very robust way. TRACARDI with is API first approach enables you to collect data from multiple channels. Regardless if it is web site, mobile app or CRM system open Api let you send data for further processing. Integrate data into one consistent user profile.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    sar2html
    Sar2html is web based frontend for performance monitoring. It converts sar binary data to graphical format and keep historical data in it's database. Project homepage is here: https://github.com/cemtan/sar2html.git Supported Operating Systems: HPUX 11.11, 11.23, 11,31 Solaris 5.9, 5.10, 5.11 Redhat 3, 4, 5, 6, 7 Suse 8, 9, 10, 11, 12 Ubuntu 18, 20 If you have customers facing performance problems on operating systems listed above you may send sar2ascii to collect performance data. ...
    Leader badge
    Downloads: 4 This Week
    Last Update:
    See Project
  • 3
    ...I would like to implement the ones listed here in the MFR-LQ project. 01. Learning control 02. Initial value response 03. Adaptive control 04. Add-value control I will implement the four controls of and collect data. by hironori takai e-mail: hironori.takai.pc.2@gmail.com e-mail: hironoritakaipc2@cock.li
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    lxspider

    lxspider

    Educational Python web scraping case collection for many sites

    lxSpider is a collection of web scraping examples designed primarily for learning and experimentation with data extraction techniques. It gathers numerous crawler implementations that demonstrate how to collect data from a wide range of websites and online services. It focuses heavily on practical cases that illustrate how different platforms handle requests, authentication parameters, and anti-scraping protections. lxSpider includes examples targeting areas such as e-commerce platforms, social media services, content sites, research databases, and information portals. ...
    Downloads: 9 This Week
    Last Update:
    See Project
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Start Free
  • 5
    arxiv-collector

    arxiv-collector

    Little Python script to collect LaTeX sources for upload to the arXiv

    A little Python script to collect LaTeX sources for upload to the arXiv. Install with pip install arxiv-collector or conda install -c conda-forge arxiv-collector, or just download arxiv_collector.py, it's a stand-alone script with no dependencies. Works with any reasonable version of Python 3, or 2.7 if you really must.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6

    collect_elemental

    Collects necessary TechSupport data for AWS Elemental Users

    This script provides AWS Elemental TechSupport with all the necessary logs and data specific to troubleshooting issues. Run this on any conductor, statmux, or encoder. It collects the following: * System Logs (/var/log) * Web (/opt/elemental_se/web/log) * Database logs (/data/pgsql/logs) * Database Backups (/home/elemental/database_backups) * Elemental Core Dumps (/data/server/cores) * System Core Dumps (/var/crash) * IPMI data (ipmi sel list sensor) * Elemental Node Info ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    Collectral

    Collectral

    Free Mobile Data Collection Software, Dynamic Mobile Forms App

    Collectral allow you to collect data from from Android Mobile Applications directly into your servers. Collectral Consist from 3 components 1. Main Collectral Site where you need to register and set key 2. Collectral ERP - it is WordPress plugin 3. Android Application - Which you need to get from google play In this page you can find only WordPress Plugin as download Android component located in : https://play.google.com/store/apps/details?
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    SQL Server Monitoring &Management System

    SQL Server Monitoring &Management System

    SQL Server Monitoring, Management & Alerting System

    FREE DOWNLOAD! Starting with 7 days Trial and switch to fully functioning FREE VERSION. The Free version limited to 3 Windows Servers (Multiple Instances), 1 Linux Server and 1 Azure Database. The powerful tool which helps SQL Server DBAs to do their work with ease. Available as Software with a Service (SWaS). It’s really easy to identify all kinds of problems with a couple of clicks and make your daily work more productive. For more detailed information and latest version...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    BlackWidow

    BlackWidow

    Python web scanner for OSINT gathering and OWASP vulnerability fuzzing

    BlackWidow is a Python-based web application scanning tool designed to crawl target websites and collect open-source intelligence (OSINT) while identifying potential security vulnerabilities. It functions as a web spider that systematically explores a site to gather valuable information such as URLs, dynamic parameters, subdomains, email addresses, and phone numbers associated with the target domain. By automatically extracting this data, BlackWidow helps security professionals and researchers build a clearer understanding of a website’s structure and publicly accessible information. ...
    Downloads: 7 This Week
    Last Update:
    See Project
  • Fully Managed MySQL, PostgreSQL, and SQL Server Icon
    Fully Managed MySQL, PostgreSQL, and SQL Server

    Automatic backups, patching, replication, and failover. Focus on your app, not your database.

    Cloud SQL handles your database ops end to end, so you can focus on your app.
    Start Free
  • 10
    Tofu

    Tofu

    Tofu is a Python tool for generating synthetic UK Biobank data

    Tofu is a Python library for generating synthetic UK Biobank data. The UK Biobank is a large open-access prospective research cohort study of 500,000 middle-aged participants recruited in England, Scotland and Wales. The study has collected and continues to collect extensive phenotypic and genotypic detail about its participants, including data from questionnaires, physical measures, sample assays, accelerometry, multimodal imaging, genome-wide genotyping and longitudinal follow-up for a wide range of health-related outcomes. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    gasmask

    gasmask

    All-in-one OSINT tool for reconnaissance and domain intelligence

    ...These sources include services like Shodan, Censys, Netcraft, VirusTotal, GitHub, and various DNS-related services, allowing investigators to build a comprehensive profile of a domain or organization. GasMasK is commonly used by penetration testers, red teams, and security researchers who need to collect reconnaissance data.
    Downloads: 14 This Week
    Last Update:
    See Project
  • 12
    WorldBrain's Memex

    WorldBrain's Memex

    Browser Extension to full-text search your browsing history

    Curate, annotate and discuss the most valuable content and ideas. As individuals, teams and communities. Effortlessly find bookmarks again without organizing anything. Save websites and PDFs with one click. Recover everything in milliseconds. Search with any words you remember from the title or text, the time frame or domain. Declutter your notes about the things you read. No more copy-pasting important sections into your scattered notes. Highlight & annotate websites & PDFs (even locally...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    GoogleScraper

    GoogleScraper

    Python tool for scraping search engine results from many providers

    ...By running automated queries and collecting results in bulk, the project can assist with tasks such as SEO research, trend discovery, or building datasets of websites related to specific keywords. GoogleScraper also includes capabilities for running multiple scraping tasks concurrently to improve performance and increase the amount of collected data.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 14
    ShortDevs

    ShortDevs

    ShortDevs is the universe of tables and shortcodes

    Shortdevs is a tool created with html / css / php / mysql / js and jquery. Shordevs allows the user to collect, manipulate, share data on the web and it simplifies work. Shortdevs allows a non-programmer to create anything that he can imagine with the help of shortcodes and tables. In Shortdevs a table is called a "page" or "superpage". Pages are private, only the json data for the pages can be shared on the web. Superpages can be shared public or stay private,and they can be catalogs, websites,business cards,web pages, forms, charts, inventories,newspapers, games, CADs, electronic circuits, directories or anything that the user will create. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    Mahuta

    Mahuta

    IPFS Storage service with search capability

    Mahuta (formerly known as IPFS-Store) is a library to aggregate and consolidate files or documents stored by your application on the IPFS network. It provides a solution to collect, store, index, cache and search IPFS data handled by your system in a convenient way.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16

    QStammBaum

    A software to create/plot/print family trees and ancestor diagrams.

    A software to create/plot/print family trees and ancestor diagrams. It is targeted toward the typical home user (e.g. retired parent) who wants to collect information for the family, include photographs, create diagrams and add interesting stories. You can create different diagrams with flexible layout.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    Falcon+

    Falcon+

    An open-source and enterprise-level monitoring system

    ...Scalable monitoring system is necessary to support rapid business growth. Each module of Open-Falcon is super easy to scale horizontally. With RRA(Round Robin Archive) mechanism, the one-year history data of 100+ metrics could be returned in just one second. No critical single point of failure, easy to operate and deploy. Falcon-agent has already 400+ built-in server metrics. Users can collect their customized metrics by writing plugins or just simply run a script/program to relay metrics to falcon-agent. For easier management of alerting rules, Open-Falcon supports strategy templating, inheritance, and multiple alerting method, and callback for recovery. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    Scalable Distributed Deep-RL

    Scalable Distributed Deep-RL

    A TensorFlow implementation of Scalable Distributed Deep-RL

    Scalable Agent is the open implementation of IMPALA (Importance Weighted Actor-Learner Architectures), a highly scalable distributed reinforcement learning framework developed by Google DeepMind. IMPALA introduced a new paradigm for efficiently training agents across large-scale environments by decoupling acting and learning processes. In this architecture, multiple actor processes interact with their environments in parallel to collect trajectories, which are then asynchronously sent to a...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 19

    Captune

    Capture network traffiq and Analyze Data to find Adult Site

    A DotNet Core 2.0 project. Captune is a system/solution to find adult site from network traffiq of a server. This first collect network tarffiq and saved to a file by - ## Captune.bat # Then another application - ## webcontent.bat ## analyze these traffiq and find out adult site and Save to a file named ## list.txt # It test a site for 3 times and sends result as {true: ####, False: ####} Where "true" "false" has decimal values. if "true" value is greater then "false" then...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20

    dadosSemiotica

    Collecter and manager of semiotica annalisis data

    This program is a web application to collect and organize data of text analysis. It works with sets of texts and the analysis are done on portions of the length of a sentence. One of the preprocessing modules is based on CoGroo (A LibreOffice & OpenOffice.org Portuguese Grammar Checker).
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    WeChatSogou

    WeChatSogou

    Python library to crawl and retrieve data from WeChat accounts

    WechatSogou is an open source Python library designed to retrieve data from WeChat official accounts by using the Sogou WeChat search service as its data source. It provides developers with a programmatic way to search for public accounts and collect article information without manually browsing the search interface. It functions as a crawler interface that sends requests to the search engine, retrieves results, and converts the returned pages into structured data that can be used in applications or analysis pipelines. ...
    Downloads: 15 This Week
    Last Update:
    See Project
  • 22
    WKZombie

    WKZombie

    WKZombie is a Swift framework for iOS/OSX to navigate within websites

    WKZombie is a Swift framework for iOS/OSX to navigate within websites and collect data without the need of a User Interface or API, also known as a Headless browser. It can be used to run automated tests/snapshots and manipulate websites using Javascript. WKZombie is an iOS/OSX web-browser without a graphical user interface. It was developed as an experiment in order to familiarize myself with using functional concepts written in Swift 4.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    haipproxy

    haipproxy

    Distributed proxy IP pool for web crawlers using Scrapy and Redis

    HAipproxy is a distributed proxy IP pool system designed to collect, manage, and provide large numbers of proxy addresses for web crawling tasks. It automatically crawls proxy resources from the internet and aggregates them into a centralized pool that can be accessed by distributed spiders and scraping systems. It is built using Python and relies on Scrapy for high-performance crawling while Redis is used for data storage, communication, and task coordination between components. ...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 24
    Apache2 module that collects, aggregates and displays server's runtime data. User may configure what data to collect and time intervals (up to 24 hours) to aggregate them.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    Psygraph

    Psygraph

    Code for the Psygraph mobile application

    ...It is a scientific instrument that is easy to use. It makes an excellent general-purpose stopwatch and timer, but you can also categorize the data that you collect, so that time, location, and velocity data is associated with that category (or activity). Psygraph allows quantification and visualization of your behavior (biofeedback) by utilizing data gathered from your mobile device. It provides objective measurements of what you spend your time doing, and where you do it. Your location can be monitored using either GPS or cell network sources.
    Downloads: 0 This Week
    Last Update:
    See Project