Search Results for "data collect" - Page 4
Sort By:
Showing 297 open source projects for "data collect"
View related business solutions-
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
Argus
Python toolkit for OSINT and reconnaissance with 135+ modules
Argus is a Python-based open source toolkit designed to simplify information gathering and reconnaissance tasks in cybersecurity. It provides an integrated command-line environment that consolidates numerous reconnaissance utilities into a single framework. The tool enables users to collect data about networks, domains, web applications, and infrastructure in an organized and efficient manner. Argus includes a modular architecture with more than 130 modules that support activities such as DNS analysis, port scanning, web application inspection, and threat intelligence lookups. Its interactive CLI allows users to browse available modules, configure targets, run scans, and review results from within a unified interface. ... -
2
GRR
GRR Rapid Response, remote live forensics for incident response
GRR Rapid Response is an incident response framework focused on remote live forensics. It consists of a python client (agent) that is installed on target systems, and python server infrastructure that can manage and talk to clients. The goal of GRR is to support forensics and investigations in a fast, scalable manner to allow analysts to quickly triage attacks and perform analysis remotely. GRR client is deployed on systems that one might want to investigate. On every such system, once... -
3
news-please
Python tool for crawling and extracting structured data from news site
...Developers can use the software either as a standalone command line application or integrate it into their own Python applications through its library interface. Extracted article data can be stored in different formats and systems, including JSON files or database-backed storage solutions. -
4
Node.js Basics
Node.js Basics ( v24.x )
...Its material addresses event-driven programming, callbacks, callback hell, asynchronous behavior, commands, APIs, programming exercises, and frequently asked questions. Separate reference files collect multiple-choice questions, data-structure material, design-pattern notes, and practical Node.js examples. The repository also contains sample projects for MySQL integration and several JWT authentication approaches. REST API development is a recurring theme throughout the collection. Most of the repository is written in JavaScript and is organized as a self-study reference rather than a single application. ... -
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
5
autocrawler
Multiprocess Selenium crawler for downloading images by keywords
AutoCrawler is a Python-based image crawling tool designed to automatically download large numbers of images from search engines using automated browser interaction. It uses Selenium and a Chrome browser driver to navigate image search pages and collect image sources based on keywords provided by the user. AutoCrawler supports multiprocess and multithreaded downloading, which allows it to retrieve images faster by running several tasks simultaneously. Users provide search terms through a... -
6
AWS Amplify
A declarative JavaScript library for application development
The Amplify open-source client libraries provide use-case-centric, opinionated, declarative, and easy-to-use interfaces across different categories of cloud-powered operations enabling mobile and web developers to easily interact with their backends. These libraries are powered by the AWS cloud and offer a pluggable model which can be extended to use other providers. The libraries can be used with both new backends created using the Amplify CLI and existing backend resources. The Amplify... -
7
Index
The SOTA Open-Source Browser Agent
Index is an open-source browser automation agent designed to autonomously perform complex tasks across websites by transforming web interfaces into programmable APIs. The system enables developers to instruct an AI agent to interact with web pages using natural language rather than traditional automation scripts. Instead of writing detailed browser automation code, users can describe the desired task and allow the agent to interpret the page structure, interact with elements, and complete... -
8
IVRE
Open source framework for large scale network reconnaissance and analy
IVRE is an open source network reconnaissance framework designed to collect, process, and analyze intelligence gathered from network scans and traffic data. It provides tools for both active and passive reconnaissance, enabling users to understand how networks behave and identify exposed services or infrastructure. The framework integrates with well known security and scanning tools such as Nmap, Masscan, ZGrab2, ZDNS, and Zeek to gather large amounts of network intelligence. ... -
9
gpt-llm-trainer
Experimental notebook pipeline for creating language models
gpt-llm-trainer is an experimental notebook pipeline for creating task-specific fine-tuned language models from a plain task description. It reduces the work normally required to collect examples, format a dataset, split training and validation data, and run fine-tuning code. The system can generate prompts and responses with larger models, then prepare that synthetic dataset for model training. It includes workflows for LLaMA 2 7B, GPT-3.5 fine-tuning, and a Claude-to-LLaMA training variant. The project is designed for fast experimentation rather than polished enterprise model operations. ... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
10
KazumiRules
Kazumi's rule hosting repository
KazumiRules is the hosted rules repository for the Kazumi anime application. It stores community-contributed JSON rule files that define how Kazumi can collect and parse anime content from supported sources. The repository is organized around rule contribution rather than application code, making it a data and configuration companion to the main Kazumi app. Contributors are asked to submit or update only rule files, while generated files such as the index and README are updated automatically after merges. ... -
11
Scope Sentry
Cyberspace asset mapping and vulnerability scanning platform
...ScopeSentry combines multiple reconnaissance and vulnerability assessment capabilities such as subdomain enumeration, port scanning, directory scanning, and sensitive information detection. ScopeSentry can automatically identify assets and services, extract URLs, and crawl websites to collect useful security data for further analysis. It also includes vulnerability scanning and subdomain takeover detection to help identify common security weaknesses across web infrastructure. It supports distributed scanning with multiple nodes, allowing large scanning tasks to be performed efficiently across different systems. -
12
IntelOwl
Centralized platform for automated threat intelligence analysis
...IntelOwl was created to automate repetitive investigation tasks typically performed by security operations center (SOC) analysts, helping teams focus on deeper analysis and incident response. The system features a modular architecture built around plugins that allow new analyzers, connectors, and integrations to be added easily. These plugins can collect data from external intelligence platforms or generate insights using internal analysis tools such as YARA or static malware analyzers. -
13
NSFW Filter
Google Chrome extension that blocks NSFW images
A Google Chrome extension that blocks NSFW images from the web pages that you load using TensorFlow JS. NSFW Filter web extension blocks NSFW content using AI. NSFW Filter allows you to block inappropriate, Not-Safe-For-Work content, protecting you online. A browser extension that blocks NSFW images from the web pages that you load using TensorFlowJS. When a web page is loaded, all the images remain hidden until they are found to be NSFW or not. If they are found to be NSFW, they remain... -
14
Xianyu Intelligent Monitor Bot
AI tool for real-time monitoring and analysis of Goofish listings
ai-goofish-monitor is an open source automation tool designed to monitor listings on the Goofish second-hand marketplace and analyze them using artificial intelligence. It combines browser automation with AI-based analysis to automatically search, collect, and evaluate newly posted items that match a user’s purchase criteria. It uses Playwright to simulate real user interactions with the marketplace, allowing the system to retrieve product data and track updates in near real time. ai-goofish-monitor can run multiple monitoring tasks simultaneously, each configured with specific keywords, price ranges, and filtering conditions. ... -
15
pmacct
pmacct is a small set of multi-purpose passive network monitoring tool
pmacct is a small set of multi-purpose passive network monitoring tools. It can account for, classify, aggregate, replicate, and export forwarding-plane data, ie. IPv4 and IPv6 traffic; collect and correlate control-plane data via BGP and BMP; collect and correlate RPKI data; collect infrastructure data via Streaming Telemetry. Each component works both as a standalone daemon and as a thread of execution for correlation purposes (ie. enriching NetFlow with BGP data). -
16
Atheris
A Coverage-Guided, Native Python Fuzzer
...It supports structured input strategies and custom mutators, which is especially helpful for text and data formats common in Python workloads. In practice, Atheris compresses weeks of edge-case brainstorming into hours of automated exploration with actionable, minimized reproductions. -
17
GoToSocial
Fast, fun, small ActivityPub server
GoToSocial is an ActivityPub social network server, written in Golang. With GoToSocial, you can keep in touch with your friends, post, read, and share images and articles. All without being tracked or advertised to. It is already deployable and useable, and it federates cleanly with many other Fediverse servers (not yet all). However, many things are not yet implemented, and there are plenty of bugs! We left the alpha stage around September/October 2024, and we intend to exit beta sometime... -
18
QuantDataManager is a tool to download, manage, analyze, manipulate, convert and export high quality history data to use them in your trading platform. QuantDataManager can collect and apply broker-specific properties to exported historical data, ensuring it closely replicates live trading conditions.
-
19
dc2m
Chat via modbus TCP with plc, pac, cnc using your smartphone or pc
Chat via Modbus TCP with PLCs, PACs, and CNCs (even from the other side of the world!) using your smartphone, tablet, or PC. Receive notifications for alarms and events. Collect production data and operational statistics. -
20
TimeBilling
Order and Billing system for MSPs
...There is a Quote engine for creating a quote to send to the customer, with an email based approval process. The Quote can be converted to an Order and then a SalesInvoice for billing. It ties in with the Ticket system for adding labour charges. The system can collect Order Lines and Timesheets together onto an invoice for customer billing. It additionally has import processes for supplier data feeds. These include some bespoke processes, plus a generic framework to import data from suppliers. -
21
WS - Digital Mode Suite
formerly known as WSJT-X Improved
WS is an innovative suite of programs for weak-signal digital communication in amateur radio by Uwe Risse DG2YCB et al., formerly known as WSJT-X Improved. WS grew out of WSJT-X by Joe Taylor K1JT, Steve Franke K9AN, Bill Somerville G4WJS, Uwe Risse DG2YCB and others (https://sourceforge.net/projects/wsjt/). The WS Suite consists of three programs: WS (the main program), WS-MAP (wideband Q65 monitor) and EME65 (wideband JT65/Q65 for EME). The WS main program supports FT8, FT4, FT2,... -
22
Qt Bitcoin Trader
Secure Trading Client for most popular Bitcoin exchanges
his software helps you open and cancel orders very fast. Real time data monitoring. Automated trading using JavaScript powered scripts. And now it supports JL Script, advanced strategy script language. More info https://forum.centrabit.com/viewforum.php?f=3 Next ToDo: 1 ) Advanced Charts 2 ) Add support to monitor many exchanges and currencies at the same time 3 ) Develop server to collect all ticker and depth data to provide single WebSocket connection for realtime data updates 4 ) Saving interface settings as Workspace Profiles [Done] 5 ) Develop mobile application to provide secure remote access to running application on desktop 6 ) Add plugins support to allow all developers attach any exchanges More information here: https://centrabit.com -
23
CivitAI-Post-Tracker
A local self-hosted tracker for CivitAI post analytics.
...Users are responsible for complying with CivitAI's terms, platform rules, and applicable law. Do not use this project to: - bypass authentication, age gates, access controls, or content restrictions; - scrape unrelated users or platform data at scale; - manipulate CivitAI statistics, engagement, Buzz, rankings, or visibility; - automate likes, comments, collections, follows, or other engagement actions; - collect personal data without consent; -
24
Octra-Wallet
Octra Wallet: Secure, non-custodial FHE crypto for Octra Network
...The app supports creating and importing wallets, viewing total and encrypted balances, sending and receiving OCT tokens, private transfers, and managing multiple wallets from one interface. All wallet data is encrypted and stored locally on the device, ensuring strong security without third-party custody. Octra Wallet connects directly to the Octra Network and does not collect or store personal data. Keywords: Octra Wallet APK, Octra Network wallet, OCT token wallet, crypto wallet, blockchain wallet -
25
Instagram OSINT Tool
Instagram OSINT tool for gathering profile data and public posts
InstagramOSINT is an open source intelligence (OSINT) tool designed to collect publicly accessible information from Instagram profiles. It retrieves details that are not always easily visible when browsing an Instagram account normally, allowing investigators, researchers, and developers to gather structured data about a target profile. It works by scraping publicly available profile information and extracting metadata from Instagram pages using Python.
