Search Results for "data collect"
Sort By:
Showing 37 open source projects for "data collect"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
douyin
Open source Douyin crawler for collecting and downloading public data
DouyinCrawler is an open source data collection tool designed to gather publicly available information from the Douyin platform. It demonstrates how to build a Python-based web crawler combined with a graphical interface and command line functionality. It allows users to collect data from various types of Douyin content, including user profiles, videos, hashtags, and music pages. -
2
Wiseflow
Enhance any agent's browser use skill
Wiseflow is an open-source information extraction and knowledge discovery system designed to collect, filter, and organize valuable information from large volumes of online content. The platform continuously monitors specified sources such as websites, social platforms, and other digital channels to identify relevant data according to user-defined interests or topics. By combining web crawling, content parsing, and large language model analysis, the system extracts concise insights from raw information streams and converts them into structured data that can be stored or analyzed. ... -
3
fess
Open source enterprise search server for websites, files, and data
Fess is an open source enterprise search server designed to provide powerful full-text search capabilities across multiple data sources. It enables organizations to quickly deploy a scalable search environment without requiring deep knowledge of underlying search technologies. Fess is built on top of OpenSearch and offers an integrated solution for crawling, indexing, and searching documents from websites, file systems, and various data stores. Fess includes a built-in crawler that can collect content from sources such as databases, CSV files, and shared storage, making it suitable for centralized knowledge discovery. ... -
4
SPX
A simple & straight-to-the-point PHP profiling extension
...Multi metrics capable: 22 are currently supported (various time & memory metrics, included files, objects in use, I/O...). Able to collect data without losing context. For example Xhprof (and potentially its forks) aggregates data per caller / callee pairs, which implies the loss of the full call stack and forbids timeline or Flamegraph based analysis. -
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
5
errsole.js
Collect, Store, and Visualize Logs with a Single Module
Errsole is an open-source logger for Node.js. It has a built-in web dashboard to view, filter, and search your app logs. -
6
Journiv
Self hosted private journaling app
...Because it runs on your own infrastructure (e.g., via Docker), all of your entries, moods, and memories stay under your direct control, making it a strong alternative to commercial journaling apps that collect data. The app is currently in beta and sees active development with improvements such as draft support, Markdown editing, and multimedia integration. It combines a clean, distraction-free interface with rich features like tagging, calendar views, and customizable journals, appealing to users who want both useful tools and full data sovereignty in their self-hosted ecosystems. -
7
Node.js Basics
Node.js Basics ( v24.x )
...Its material addresses event-driven programming, callbacks, callback hell, asynchronous behavior, commands, APIs, programming exercises, and frequently asked questions. Separate reference files collect multiple-choice questions, data-structure material, design-pattern notes, and practical Node.js examples. The repository also contains sample projects for MySQL integration and several JWT authentication approaches. REST API development is a recurring theme throughout the collection. Most of the repository is written in JavaScript and is organized as a self-study reference rather than a single application. ... -
8
IVRE
Open source framework for large scale network reconnaissance and analy
IVRE is an open source network reconnaissance framework designed to collect, process, and analyze intelligence gathered from network scans and traffic data. It provides tools for both active and passive reconnaissance, enabling users to understand how networks behave and identify exposed services or infrastructure. The framework integrates with well known security and scanning tools such as Nmap, Masscan, ZGrab2, ZDNS, and Zeek to gather large amounts of network intelligence. ... -
9
IntelOwl
Centralized platform for automated threat intelligence analysis
...IntelOwl was created to automate repetitive investigation tasks typically performed by security operations center (SOC) analysts, helping teams focus on deeper analysis and incident response. The system features a modular architecture built around plugins that allow new analyzers, connectors, and integrations to be added easily. These plugins can collect data from external intelligence platforms or generate insights using internal analysis tools such as YARA or static malware analyzers. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
Xianyu Intelligent Monitor Bot
AI tool for real-time monitoring and analysis of Goofish listings
ai-goofish-monitor is an open source automation tool designed to monitor listings on the Goofish second-hand marketplace and analyze them using artificial intelligence. It combines browser automation with AI-based analysis to automatically search, collect, and evaluate newly posted items that match a user’s purchase criteria. It uses Playwright to simulate real user interactions with the marketplace, allowing the system to retrieve product data and track updates in near real time. ai-goofish-monitor can run multiple monitoring tasks simultaneously, each configured with specific keywords, price ranges, and filtering conditions. ... -
11
sitespeed.io
Monitor, analyze and optimize your website speed and performance
Sitespeed.io is an open source tool that helps you monitor, analyze and optimize your website speed and performance, based on performance best practices advices from the coach and collecting browser metrics using the Navigation Timing API, User Timings and Visual Metrics (FirstVisualChange, SpeedIndex & LastVisualChange). Measuring performance shouldn’t be hard, you should be able to have full control of your metrics, own your own data and you should be able to do it without paying top... -
12
Quiz/Survey/Test - QST
A Free, complete, open source universal assessment/exam platform
QST, the worlds unparalleled open source, multi-tenant, online/lan assessment software. From a quick quiz on your phone to very large scale, high stakes, proctored desktop testing, we make it easy/secure/economical. Our intuitive design contains features (Immediate detailed results, Create/Export/Import/Convert Questions, WYSIWYG/Visual Math-Chemistry Editors, Question/Item Bank, Multiple Question Types, Multiple Delivery Styles, Multiple Delivery/Results Options, Adaptive/Branching... -
13
spider_collection
Collection of Python web scraping scripts for data extraction tasks
spider_collection is a collection of Python web crawler scripts created primarily for experimentation, learning, and practical scraping tasks. spider_collection gathers multiple independent spiders designed to collect data from different platforms and services, demonstrating a variety of scraping techniques and workflows. These crawlers make use of common Python scraping tools such as requests, parsel, BeautifulSoup, and the Scrapy framework to extract structured information from web pages. Several scripts also incorporate multi-threading and proxy usage to improve scraping efficiency and help avoid common anti-scraping limitations. ... -
14
OpenCarenet CHE
Enabling community health workers to collect health data efficiently
OpenCarenet CHE is a robust and user-friendly application tailored for community health workers, facilitating seamless data collection, management, and reporting. With its mobile data collection capabilities, offline functionality, and interoperability with DHIS2, the app empowers health professionals to efficiently track patient information, aggregate primary data, and generate detailed health reports, even in areas with limited internet access. Its multilingual support and configurable... -
15
Webfunny
Front-end performance monitoring and user analytics platform
Webfunny is a lightweight front-end performance monitoring and user analytics platform designed for private deployment environments. It combines real-time client-side monitoring with customizable event tracking, allowing teams to collect both technical performance metrics and business interaction data from web applications. The system provides dashboards for error analysis, page performance, API latency, and user behavior, enabling comprehensive visibility into frontend health. Its architecture is intentionally simple to deploy, requiring only a few setup steps to run a fully self-hosted monitoring stack. ... -
16
Netflow
free netflow analyzer
This is a set of perl and php scripts that are used to collect, process, store and display netflow data. -
17
Graphite-Web
A highly scalable real-time graphing system
Graphite does two things, it stores numeric time-series data and renders graphs of this data on demand. What Graphite does not do is collect data for you, however, there are some tools out there that know how to send data to graphite. Even though it often requires a little code, sending data to Graphite is very simple. Graphite is an enterprise-scale monitoring tool that runs well on cheap hardware. -
18
CloudMapper
CloudMapper analyzes your Amazon Web Services (AWS) environments
...If you want to add your own private commands, you can create a private_commands directory and add them there. You must have AWS credentials configured that can be used by the CLI with reading permissions for the different metadata to collect. Cloudmapper needs to make IAM calls and cannot use session credentials for collection, so you cannot use the AWS-vault server if you want to collect data, and must pass role credentials indirectly or configure AWS credentials manually inside the container. Generate HTML report. Includes a summary of the accounts and audit findings. ... -
19
Plupload
JavaScript API for building file uploaders
...In some browsers, mostly in those based on WebKit, it is possible to drag and drop whole folders. Since we emulate as much of HTML5 as possible, we are able (among other things) to provide access to raw file data, even in such environments that do not normally support it. One of the biggest benefits of this is that we can display the thumbnails instantly, right as you select the images in the dialog or drag&drop them from the desktop. We slice the files in chunks and send them out one by one. You can then safely collect them on the server and combine into original file. -
20
nightTab
A neutral new tab page accented with a chosen colour
A neutral new tab page accented with a chosen color. Customize the layout, style, background and bookmarks with nightTab. Make the browser start page dark (or light, or anything in between). Do not access user information. This means nightTab will not request browser permissions. Aim to make everything on the user interface, within reason, customizable. Aim to make the user experience easy while supporting the above. Keep nightTab open source. Sharing the look and feel of one Bookmark to... -
21
Trape
OSINT tool for tracking users and analyzing browser data online
...It provides researchers, security professionals, and organizations with a platform for studying how attackers could gather intelligence through social engineering techniques. The tool can clone websites and monitor interactions in order to collect data from visitors, allowing investigators to observe user behavior and session activity. Trape was originally created to educate the public about how large internet services may obtain confidential information such as session status or browser details without users realizing it. Over time, it has evolved into a research platform that helps analysts track cybercriminal activity and study online tracking mechanisms. -
22
ShortDevs
ShortDevs is the universe of tables and shortcodes
Shortdevs is a tool created with html / css / php / mysql / js and jquery. Shordevs allows the user to collect, manipulate, share data on the web and it simplifies work. Shortdevs allows a non-programmer to create anything that he can imagine with the help of shortcodes and tables. In Shortdevs a table is called a "page" or "superpage". Pages are private, only the json data for the pages can be shared on the web. Superpages can be shared public or stay private,and they can be catalogs, websites,business cards,web pages, forms, charts, inventories,newspapers, games, CADs, electronic circuits, directories or anything that the user will create. ... -
23
dadosSemiotica
Collecter and manager of semiotica annalisis data
This program is a web application to collect and organize data of text analysis. It works with sets of texts and the analysis are done on portions of the length of a sentence. One of the preprocessing modules is based on CoGroo (A LibreOffice & OpenOffice.org Portuguese Grammar Checker). -
24
elasticsearch-head
A web front end for an elastic search cluster
elasticsearch-head is a web front end for browsing and interacting with an Elastic Search cluster. elasticsearch-head is hosted and can be downloaded or forked at github. There are two ways of running and installing elasticsearch-head. Running as a plugin of ElasticSearch (this is the preferred method). And running as a standalone webapp. By default es-head will immediately attempt to connect to a cluster node at http://localhost:9200/. Enter a different node address in the connect box and... -
25
Bibliograph
Open Source Online Bibliographic Data Management
Bibliograph is a powerful and intuitive open source web application for the collaborative collection, editing and publishing of bibliographic data such as a bibliographies, small library collections or shared research data. It features a modern user interface similar to a desktop application.
