Showing 76 open source projects for "data collect"

View related business solutions
  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New customers can spin up VMs, build with AI, and query data at no cost.

    Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
    Start Free
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Start Free
  • 1
    speedtest-cli

    speedtest-cli

    Command line interface for testing internet bandwidth using speedtest

    ...Test the internet connection of your Linux desktop, a remote server or even lower-powered devices such as the Raspberry Pi with the Speedtest Server Network. Set up automated scripts to collect connection performance data, including trends over time.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 2
    TRACARDI - Customer Data Platform

    TRACARDI - Customer Data Platform

    TRACARDI free open-source customer data platform

    TRACARDI is easy to use and free GUI for Apache Unomi. Unomi is an open source Customer Data Platform that allows anyone to collect user profiles and manage them in a very robust way. TRACARDI with is API first approach enables you to collect data from multiple channels. Regardless if it is web site, mobile app or CRM system open Api let you send data for further processing. Integrate data into one consistent user profile.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    sar2html
    Sar2html is web based frontend for performance monitoring. It converts sar binary data to graphical format and keep historical data in it's database. Project homepage is here: https://github.com/cemtan/sar2html.git Supported Operating Systems: HPUX 11.11, 11.23, 11,31 Solaris 5.9, 5.10, 5.11 Redhat 3, 4, 5, 6, 7 Suse 8, 9, 10, 11, 12 Ubuntu 18, 20 If you have customers facing performance problems on operating systems listed above you may send sar2ascii to collect performance data. ...
    Leader badge
    Downloads: 4 This Week
    Last Update:
    See Project
  • 4
    lxspider

    lxspider

    Educational Python web scraping case collection for many sites

    lxSpider is a collection of web scraping examples designed primarily for learning and experimentation with data extraction techniques. It gathers numerous crawler implementations that demonstrate how to collect data from a wide range of websites and online services. It focuses heavily on practical cases that illustrate how different platforms handle requests, authentication parameters, and anti-scraping protections. lxSpider includes examples targeting areas such as e-commerce platforms, social media services, content sites, research databases, and information portals. ...
    Downloads: 9 This Week
    Last Update:
    See Project
  • Go from Code to Production URL in Seconds Icon
    Go from Code to Production URL in Seconds

    Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

    Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
    Start Free
  • 5
    arxiv-collector

    arxiv-collector

    Little Python script to collect LaTeX sources for upload to the arXiv

    A little Python script to collect LaTeX sources for upload to the arXiv. Install with pip install arxiv-collector or conda install -c conda-forge arxiv-collector, or just download arxiv_collector.py, it's a stand-alone script with no dependencies. Works with any reasonable version of Python 3, or 2.7 if you really must.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    BlackWidow

    BlackWidow

    Python web scanner for OSINT gathering and OWASP vulnerability fuzzing

    BlackWidow is a Python-based web application scanning tool designed to crawl target websites and collect open-source intelligence (OSINT) while identifying potential security vulnerabilities. It functions as a web spider that systematically explores a site to gather valuable information such as URLs, dynamic parameters, subdomains, email addresses, and phone numbers associated with the target domain. By automatically extracting this data, BlackWidow helps security professionals and researchers build a clearer understanding of a website’s structure and publicly accessible information. ...
    Downloads: 7 This Week
    Last Update:
    See Project
  • 7
    Tofu

    Tofu

    Tofu is a Python tool for generating synthetic UK Biobank data

    Tofu is a Python library for generating synthetic UK Biobank data. The UK Biobank is a large open-access prospective research cohort study of 500,000 middle-aged participants recruited in England, Scotland and Wales. The study has collected and continues to collect extensive phenotypic and genotypic detail about its participants, including data from questionnaires, physical measures, sample assays, accelerometry, multimodal imaging, genome-wide genotyping and longitudinal follow-up for a wide range of health-related outcomes. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    gasmask

    gasmask

    All-in-one OSINT tool for reconnaissance and domain intelligence

    ...These sources include services like Shodan, Censys, Netcraft, VirusTotal, GitHub, and various DNS-related services, allowing investigators to build a comprehensive profile of a domain or organization. GasMasK is commonly used by penetration testers, red teams, and security researchers who need to collect reconnaissance data.
    Downloads: 14 This Week
    Last Update:
    See Project
  • 9
    GoogleScraper

    GoogleScraper

    Python tool for scraping search engine results from many providers

    ...By running automated queries and collecting results in bulk, the project can assist with tasks such as SEO research, trend discovery, or building datasets of websites related to specific keywords. GoogleScraper also includes capabilities for running multiple scraping tasks concurrently to improve performance and increase the amount of collected data.
    Downloads: 2 This Week
    Last Update:
    See Project
  • Demo Series - Small Business Backup By Veeam Icon
    Demo Series - Small Business Backup By Veeam

    Learn how to protect your Microsoft 365 data, with simple, actionable tips today.

    Watch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
    Watch Demo Series
  • 10
    Scalable Distributed Deep-RL

    Scalable Distributed Deep-RL

    A TensorFlow implementation of Scalable Distributed Deep-RL

    Scalable Agent is the open implementation of IMPALA (Importance Weighted Actor-Learner Architectures), a highly scalable distributed reinforcement learning framework developed by Google DeepMind. IMPALA introduced a new paradigm for efficiently training agents across large-scale environments by decoupling acting and learning processes. In this architecture, multiple actor processes interact with their environments in parallel to collect trajectories, which are then asynchronously sent to a...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 11

    dadosSemiotica

    Collecter and manager of semiotica annalisis data

    This program is a web application to collect and organize data of text analysis. It works with sets of texts and the analysis are done on portions of the length of a sentence. One of the preprocessing modules is based on CoGroo (A LibreOffice & OpenOffice.org Portuguese Grammar Checker).
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    WeChatSogou

    WeChatSogou

    Python library to crawl and retrieve data from WeChat accounts

    WechatSogou is an open source Python library designed to retrieve data from WeChat official accounts by using the Sogou WeChat search service as its data source. It provides developers with a programmatic way to search for public accounts and collect article information without manually browsing the search interface. It functions as a crawler interface that sends requests to the search engine, retrieves results, and converts the returned pages into structured data that can be used in applications or analysis pipelines. ...
    Downloads: 15 This Week
    Last Update:
    See Project
  • 13
    haipproxy

    haipproxy

    Distributed proxy IP pool for web crawlers using Scrapy and Redis

    HAipproxy is a distributed proxy IP pool system designed to collect, manage, and provide large numbers of proxy addresses for web crawling tasks. It automatically crawls proxy resources from the internet and aggregates them into a centralized pool that can be accessed by distributed spiders and scraping systems. It is built using Python and relies on Scrapy for high-performance crawling while Redis is used for data storage, communication, and task coordination between components. ...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 14

    MerDAQ

    A DAQ solution in Python 2 for your Ardruino

    MerDAQ is a data acquisition GUI and other tools for collecting and storing time dependent. Originally designed to collect 4 temperature data vs. time and plot one of the temperatures in real time with matplotlib. Ideal for use with Arduino.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    ulogme

    ulogme

    Automatically collect and visualize usage statistics in Ubuntu/OSX

    ulogme is a local activity-tracking tool for visualizing how computer time is spent throughout the day. It records the title of the active window and the frequency of key presses, then turns those logs into interactive HTML timelines. Users can add notes to specific moments or summarize an entire day for additional context. Everything is stored and processed locally rather than uploaded to a remote service. Its browser interface is built with HTML, CSS, JavaScript, and D3 and supports both...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Advanced Launcher

    Advanced Launcher

    xbmc application launcher

    The Advanced Launcher add-on is able to launch any Linux and Windows applications that support command line instructions directly from the XBMC GUI. This Add-on also provide the possibility, to download from several Internet databases and manage meta-data informations and images linked to these applications.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 17
    Graphically simple but operatively complex, in this game the goal is to collect enough resources to complete your rectangle before the opponent. Be sure to get the game data, rf2.py, and rf2-conf.py
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    HTTP functional and non-functional (load and performance) toolkit based on jython/grinder (http://grinder.sf.net) ...includes capabilities to support: SOA services, REST, json/xml encoding, AES and WS security ... and a stub to collect requests
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Graphical OS fingerprinting
    GraphicalOSfp is a python application which aims to collect random data issued by remote systems in IP and TCP sequences. These data are then displayed in a 3D referencial to highlight an attractor of the random engine of the remote machine.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Interface to collect data from a Consort R305 unit via RS-232. It allows to record data from 2 units with a total of 4 channels. The graphical interface displays the value of the channels as graphs and saves them in a CSV file.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    Gnmond is a monitoring tool for computer clusters, that collect data originating from individual hosts, analyzes it and provides a concise view of the individual cluster's state to other monitoring systems.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Collect is a data acquisition (DAQ) program realized for the Schonland Research Centre for Nuclear Sciences of Johannesburg (South Africa). It is used to gather data from CAMAC ADCs and TDCs via a GPIB interface.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23

    hemcuveGUI

    hemcuveGUI is a graphical interface for HEMCUVE++

    hemcuveGUI is a graphical interface for HEMCUVE++ (see http://tsc.unex.es/~llandesa/page17/page17.html). More specifically, hemcuveGUI lets you · to collect all the data required by HEMCUVE++, · to manage a materials database, · to call the external executable HEMCUVE++ and · to visualize its results.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24

    mycdr

    MYCDR Call Detail Records collection software

    MYCDR is a web user interface software that collect a Call Detail Records. It uses for data collection on Avaya DEFINITY/S8x00 System or Avaya IP Office.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25

    text_summurization_abstractive_methods

    Multiple implementations for abstractive text summurization

    This repo is built to collect multiple implementations for abstractive approaches to address text summarization it is built to simply run on google colab , in one notebook so you would only need an internet connection to run these examples without the need to have a powerful machine , so all the code examples would be in a jupyter format , and you don't have to download data to your device as we connect these jupyter notebooks to google drive
    Downloads: 0 This Week
    Last Update:
    See Project