Search Results for "data collect" - Page 3
Sort By:
Showing 297 open source projects for "data collect"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Veeam Data Platform v13.1Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
1
Privacy Respecting
Curated List of Privacy Respecting Services and Software
Privacy Respecting is a curated list of privacy-focused services, software, and educational resources. It is organized as a reference guide for users who want alternatives to mainstream platforms that collect more personal data than necessary. The repository covers categories such as search engines, social networks, messengers, cloud storage, VPNs, hosting, email, operating systems, browsers, video sharing, AI assistants, and maps. It also links to related security checklists and privacy education projects. The list is useful for people comparing privacy-conscious tools before changing their everyday digital habits. ... -
2
errsole.js
Collect, Store, and Visualize Logs with a Single Module
Errsole is an open-source logger for Node.js. It has a built-in web dashboard to view, filter, and search your app logs. -
3
ezXSS
ezXSS is an easy way for penetration testers and bug bounty hunters
ezXSS is an open-source XSS (Cross-Site Scripting) testing platform designed to help security researchers identify and collect XSS vulnerabilities. It acts as a payload receiver and logger, storing details about triggered XSS attacks such as the user agent, cookies, DOM, and referrer. This tool is highly useful in bug bounty hunting and penetration testing for monitoring and documenting XSS vectors in real-time. -
4
trench
Open-Source Analytics Infrastructure
...The platform enables developers to collect events such as page views, user actions, and behavioral metrics while storing them in a column-oriented analytics database optimized for time-series workloads. By combining streaming ingestion with fast analytical queries, the system supports use cases such as product analytics dashboards, observability pipelines, and machine learning data preparation. -
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
5
CUDOS Framework
Command Line Interface tool for Cloud Intelligence Dashboards
The AWS Cloud Intelligence Dashboards Framework is a set of open-source tools and templates designed to help organizations deploy and manage advanced data visualization dashboards that offer insights into cost, usage, governance, and operational health across AWS environments. It is part of the AWS Solutions Library and includes CloudFormation templates, CLI commands, and pre-built dashboards that collect, process, and visualize data from AWS billing, cost management, budgets, and usage reports in services such as Amazon QuickSight or other BI tools. ... -
6
Sensu Go
Simple. Scalable. Multi-cloud monitoring
...It is an agent-based monitoring system with built-in auto-discovery, making it very well-suited for cloud environments. Sensu uses service checks to monitor service health and collect telemetry data. It also has a number of well-defined APIs for configuration, external data input, and to provide access to Sensu's data. Sensu is extremely extensible and is commonly referred to as "the monitoring router". The shift from static to dynamic infrastructure requires a change in approach to monitoring, from host-based to functional role-based. ... -
7
Grafana Pyroscope
Continuous Profiling Platform. Debug performance issues
Collect, store, and analyze profiles from various external profiling tools in one central location. Link to your Open Telemetry tracing data and get request-specific or span-specific profiles to enhance other observability data like traces and logs. -
8
Shynet
Modern, privacy-friendly, and detailed web analytics
...They require handing all of your visitors' info to a third-party company They use cookies to track visitors across sessions, so you need to have those annoying cookie notices. They collect so much personal data that even the NSA is jealous. They are closed source and/or expensive, often with limited data portability. They are hard to use. Shynet has none of these caveats. You host it yourself, so the data is yours. It works without cookies, so you don't need any intrusive cookie notices. It collects just enough data to be useful, but not enough to be creepy. ... -
9
GraphQL Mesh
GraphQL Mesh — Query anything, run anywhere
GraphQL Mesh allows you to use GraphQL query language to access data in remote APIs that don't run GraphQL (and also ones that do run GraphQL). It can be used as a gateway to other services or run as a local GraphQL schema that aggregates data from remote APIs. The goal of GraphQL Mesh is to let developers easily access services that are written in other APIs specs (such as gRPC, OpenAPI/Swagger, OData, SOAP/WSDL, Apache Thrift, Mongoose, PostgreSQL, Neo4j, and also GraphQL) with GraphQL... -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
10
Go Recipes
Collection of handy tools for Go projects
Visualize the distribution of code coverage in your project. This helps to identify code areas with high and low coverage. Useful when you have a large project with lots of files and packages. This 2D image-hash of your project should be more representative than a single number. For each module, the node representing the greatest version (i.e., the version chosen by Go's minimal version selection algorithm) is colored green. Other nodes, which aren't in the final build list, are colored grey... -
11
PerfView
PerfView is a CPU and memory performance-analysis tool
...PerfView is built on a library called Microsoft.Diagnostics.Tracing.TraceEvent, which knows how to both collect and parse Event Tracing for Windows (ETW) data. Thus if there is any information that PerfView collects and processes that you would like to manipulate yourself programmatically, you would probably be interested in the TraceEvent Library Documentation. -
12
Harpoon
Command line OSINT and threat intelligence automation tool
...Harpoon integrates with numerous security and data services such as Shodan, VirusTotal, AlienVault OTX, and many other intelligence providers to retrieve information about domains, IP addresses, emails, and other indicators. Many commands rely on API keys that can be configured through a central configuration file, allowing users to connect their own intelligence accounts and data sources. -
13
QueryList
Progressive PHP web crawler framework with jQuery-like DOM parsing
QueryList is an extensible PHP web scraping and crawling framework designed to extract and process data from web pages. It provides a simple and expressive API that allows developers to collect structured information from HTML documents using familiar DOM traversal techniques. It is built on top of phpQuery and uses CSS3 selectors similar to those found in jQuery, making it easy for developers to query and manipulate page elements during scraping tasks. -
14
JSON Lint
JSON Lint for PHP
JSON Lint is a PHP library and command-line tool for validating and parsing JSON documents. Its lint method returns detailed parsing errors without decoding the input, while parse produces PHP values and throws exceptions when the document is invalid. Error messages include the relevant line, nearby text, a position marker, and the tokens expected by the parser. Optional flags can reject duplicate object keys, preserve them under generated names, or collect repeated values into arrays. The... -
15
D4RL
Collection of reference environments, offline reinforcement learning
...Researchers can load a dataset for a given task (e.g., maze navigation, manipulation) and apply their algorithm without the need to collect fresh transitions, which accelerates experimentation and comparison. The API is based on Gymnasium (via gym.make) and each environment also exposes a method get_dataset() that returns the offline data to learn from. The repository emphasizes open science, reproducibility, and benchmarking at scale, making it easier to compare algorithms on equal footing. -
16
OpenWPM
A web privacy measurement framework
OpenWPM is a web privacy measurement framework that makes it easy to collect data for privacy studies on a scale of thousands to millions of websites. OpenWPM is built on top of Firefox, with automation provided by Selenium. It includes several hooks for data collection. Check out the instrumentation section below for more details. OpenWPM is tested on Ubuntu 18.04 via TravisCI and is commonly used via the docker container that this repo builds, which is also based on Ubuntu. ... -
17
Journiv
Self hosted private journaling app
...Because it runs on your own infrastructure (e.g., via Docker), all of your entries, moods, and memories stay under your direct control, making it a strong alternative to commercial journaling apps that collect data. The app is currently in beta and sees active development with improvements such as draft support, Markdown editing, and multimedia integration. It combines a clean, distraction-free interface with rich features like tagging, calendar views, and customizable journals, appealing to users who want both useful tools and full data sovereignty in their self-hosted ecosystems. -
18
dj-stripe
dj-stripe automatically syncs your Stripe Data to your local database
...instead of making multiple slower and unreliable consecutive network calls only to parse through 1 or more of Stripe’s JSON like objects! We make it simple for you to collect sensitive data such as credit card numbers and remain PCI compliant. This means the sensitive data is sent directly to Stripe instead of passing through your server. We support all Stripe supported wallets including but not limited to Apple Pay and Google Pay. -
19
Pixie
Instant Kubernetes-Native Application Observability
...Use Pixie to view the high-level state of your cluster (service maps, cluster resources, application traffic) and also drill down into more detailed views (pod state, flame graphs, individual full-body application requests). Pixie uses eBPF to automatically collect telemetry data such as full-body requests, resource and network metrics, application profiles, and more. Pixie collects, stores and queries all telemetry data locally in the cluster. Pixie uses less than 5% of cluster CPU and in most cases less than 2%. PxL, Pixie’s flexible Pythonic query language, can be used across Pixie’s UI, CLI, and client APIs. -
20
MySQLTuner
Script written in Perl to assist with MySQL configurations
MySQLTuner is a script written in Perl that will assist you with your MySQL configuration and make recommendations for increased performance and stability. The current configuration variables and status data is retrieved and presented in a brief format along with some basic performance suggestions. MySQLTuner supports ~300 indicators for MySQL/MariaDB/Percona Server in this last version. MySQLTuner is maintained and indicator collect is increasing week after week supporting a lot of configuration such as Galera Cluster, TokuDB, Performance schema, Linux OS metrics, InnoDB, MyISAM, Aria, etc. ... -
21
MCM-ICM
Mathematical Contest resources
MCM-ICM is a curated archive of Outstanding Winner (“O-奖/特等奖”) solution papers from the Mathematical Contest in Modeling and the Interdisciplinary Contest in Modeling, spanning the early 2000s through recent years. The repository is organized by year, with per-year folders that collect the top-ranked reports and, in later years, additional materials such as problem statements or problem notes when available. It has evolved from a single-maintainer project into a collaborative effort, with... -
22
Adafruit Unified Sensor Driver
Common sensor library
Many small embedded systems exist to collect data from sensors, analyze the data, and either take appropriate action or send that sensor data to another system for processing. One of the many challenges of embedded systems design is the fact that parts you used today may be out of production tomorrow, or system requirements may change and you may need to choose a different sensor down the road. -
23
Scweet
Scrape tweets, profiles, followers and following from Twitter/X
Scweet is a Python-based Twitter/X scraping library and CLI designed to collect tweets, profile timelines, followers, following lists, and user profile data without requiring the official Twitter/X API or a developer account. Instead of depending on deprecated unauthenticated scraping methods, it works by using X’s web GraphQL API together with authenticated browser cookies, which gives it a more current and practical approach for data extraction. -
24
OWASP Maryam
Modular OSINT framework for automated open-source intelligence gatheri
Maryam is an open source intelligence (OSINT) framework designed to automate the process of gathering and analyzing publicly available information from the internet. It provides a modular environment that enables users to collect data from search engines, open data sources, and various online services for reconnaissance and investigative purposes. Written in Python, Maryam is built to provide a flexible and extensible framework for harvesting information quickly and efficiently from open sources. Maryam helps security researchers and analysts streamline routine data-gathering tasks that typically involve searching multiple sources such as Google, Bing, or other online platforms. ... -
25
vstest
Visual Studio Test Platform is the runner and engine that powers test
The Visual Studio Test Platform is an open and extensible test platform that enables running tests, collect diagnostics data and report results. The Test Platform supports running tests written in various test frameworks, and using a pluggable adapter model. Based on user-choice, the desired test framework and its corresponding adapter can be acquired as a vsix or as NuGet package as the case may be. Adapters can be written in terms of a public API exposed by the Test Platform.
