Search Results for "collection"
Sort By:
336 projects for "collection" with 2 filters applied:
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
skycaiji
Open source web scraping system for automated data collection tasks
...It integrates with content management systems so collected data can be published automatically without manual intervention. SkyCaiji also supports automated workflows that continuously gather data and process it based on defined collection rules. Its architecture enables users to build scalable web scraping pipelines that can run unattended once configured. -
2
crawler
Collection of JS reverse engineering examples for web scraping study
crawler is a collection of web scraping and JavaScript reverse engineering examples designed for learning how modern websites protect their data and how those protections can be analyzed. It contains many case studies that demonstrate how to analyze and replicate request parameters, cookies, and encryption logic used by real websites. Each directory in the project focuses on a specific target service or scenario, showing how browser network requests and JavaScript code can be studied to reproduce API calls programmatically. ... -
3
axios-extensions
axios extensions lib, including throttle, cache, retry features etc.
A non-invasive, simple, reliable collection of axios extension. It is highly recommended to enable the request logging recorder in the development environment(disabled by default). Besides configuring the request through the cacheAdapterEnhancer, we can enjoy more advanced features via configuring every individual request. -
4
1337x Proxy List
1337x Proxy List for 2026
1337x Proxy List is an open-source repository that curates a collection of proxy and mirror sites designed to provide access to the 1337x torrent platform when it is blocked or restricted in certain regions. The project aggregates and maintains a list of working proxy URLs that allow users to bypass ISP or government restrictions by routing traffic through alternative domains. These proxy sites replicate the original 1337x interface and functionality, enabling users to browse, search, and download torrent files as if they were accessing the main site directly. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
sperm
Collection of reverse engineering articles curated for learning
sperm is a curated repository that gathers a collection of notable articles related to reverse engineering and software analysis. It primarily acts as a knowledge archive where previously published technical posts are compiled and organized for easier access and long-term reference. These articles originate from multiple technical communities and platforms and are exported into Markdown format to maintain a consistent and readable structure. sperm focuses on educational material that explores reverse engineering techniques, mobile analysis, and related technical discussions. ... -
6
Interstellar
One of the most popular modern web proxies with blazing fast speeds
Interstellar is a modern web proxy platform designed to provide users with fast, accessible browsing while bypassing network restrictions through a clean and intuitive interface. It is built primarily with JavaScript and is intended to be deployed on a server, allowing users to access blocked websites, applications, and games through a proxy layer. The project places a strong emphasis on user experience, offering a polished interface with tab management, themes, and customization options. It... -
7
Bili23 Downloader
Cross platform GUI tool for downloading videos from Bilibili sites
...It supports high performance downloads through multi-threading and includes resume capabilities so interrupted downloads can continue without starting over. It can parse different types of links such as standard video pages, short links, and collection or activity pages to automatically retrieve downloadable media. It also allows users to choose video resolution, audio quality, and encoding format based on the available sources. Additional features include downloading subtitles, comments, metadata, and artwork associated with videos. -
8
Reka UI
An open-source UI component library for building design systems
Reka UI is an open-source UI component library designed for building accessible and customizable web interfaces in Vue-based applications. The library provides a collection of unstyled UI primitives that developers can use as the foundation for creating fully customized design systems. Rather than forcing a predefined visual style, Reka UI focuses on accessibility, composability, and flexibility, allowing developers to implement their own visual themes and branding. The project evolved from the Radix Vue initiative and aims to bring the same accessibility-focused component patterns to the Vue ecosystem. ... -
9
ByePassHub
2500+ UNRESTRICTED unblockers, games, exploits, bookmarklets, and AI
...It acts as a centralized hub that compiles different bypass methods and utilities, providing users with a structured way to explore alternative access strategies. The project is typically organized as a collection of scripts, guides, and references rather than a single executable application. It emphasizes accessibility and ease of understanding, allowing users to quickly identify relevant tools or approaches for their specific use case. The repository may include examples of proxy usage, configuration techniques, or methods for circumventing access restrictions in controlled environments. ... -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
10
FEAPDER
Powerful Python crawler framework for scalable web scraping tasks
feapder is a Python-based web crawling framework designed to simplify the process of building scalable and efficient web scrapers. It focuses on providing a developer-friendly environment that makes it easier to create, run, and manage crawlers for a variety of data collection tasks. It includes several built-in spider types, such as AirSpider, Spider, TaskSpider, and BatchSpider, which address different crawling scenarios ranging from lightweight scraping to distributed and batch-based jobs. feapder supports features such as breakpoint resume, allowing crawlers to continue from where they stopped without losing progress. ... -
11
OpenSEO
Open source alternative to Semrush and Ahrefs
...It provides focused workflows for keyword research, rank tracking, competitor analysis, backlink research, site auditing, and AI visibility monitoring. A modern web interface keeps these tasks accessible without hiding them inside a large collection of unrelated reports. The platform exposes an MCP server so AI agents can work directly with SEO data and reusable agent skills. Users can run a hosted edition or self-host the application with Docker or Cloudflare. Self-hosted installations connect to DataForSEO with the user's own API key and use pay-as-you-go data rather than a mandatory software subscription. ... -
12
Scweet
Scrape tweets, profiles, followers and following from Twitter/X
...Instead of depending on deprecated unauthenticated scraping methods, it works by using X’s web GraphQL API together with authenticated browser cookies, which gives it a more current and practical approach for data extraction. The project supports a broad set of collection patterns, including searches by keyword, hashtag, user, date range, engagement thresholds, language, and location, making it useful for research, monitoring, and data gathering workflows. It is built for both local use and higher-volume runs, with support for proxies, dedicated accounts, and multi-account cookie handling to improve reliability at scale. ... -
13
douyin
Open source Douyin crawler for collecting and downloading public data
DouyinCrawler is an open source data collection tool designed to gather publicly available information from the Douyin platform. It demonstrates how to build a Python-based web crawler combined with a graphical interface and command line functionality. It allows users to collect data from various types of Douyin content, including user profiles, videos, hashtags, and music pages. -
14
Browserless
Deploy headless browsers in Docker
...The project also provides REST APIs for common automation tasks such as screenshots, PDF generation, scraping, crawling, and content export. Browserless is useful for teams that need scalable browser execution for testing, data collection, rendering, or AI-agent browsing workflows. Its deployment model supports self-hosting, private infrastructure, queues, concurrency controls, and enterprise-oriented configuration. The project’s main value is turning browser automation into a managed service layer that can be reused across applications and workflows. -
15
Weibo Crawler
Python crawler for collecting and downloading Sina Weibo user data
weibo-crawler is a Python-based data collection tool designed to retrieve information from Sina Weibo user accounts. It automates the process of gathering posts, user profile details, and engagement metrics from one or more target accounts. weibo-crawler can extract comprehensive information about users, including profile attributes such as nickname, follower count, following count, and account metadata. -
16
syslog-ng
Log management solution that improves the performance of SIEM
...Search billions of logs in seconds using full text queries with Boolean operators to pinpoint critical logs. syslog-ng Store Box provides secure, tamper-proof storage and custom reporting to demonstrate compliance. syslog-ng can deliver data from a wide variety of sources to Hadoop, Elasticsearch, MongoDB, and Kafka as well as many others. syslog-ng flexibly routes log data from X sources to Y destinations. Instead of deploying multiple agents on hosts, organizations can unify their log data collection and management. syslog-ng Store Box provides automated archiving, tamper-proof encrypted storage, granular access controls to protect log data. The largest appliance can store up to 10TB of raw logs. -
17
HTTPLeaks
All possible ways, a website can leak HTTP requests
HTTPLeaks is a security test project that catalogs ways HTML can cause a browser or renderer to send external HTTP requests. Its primary artifact is a single HTML file containing many combinations of elements and attributes that may trigger network activity. Researchers can use it to evaluate Content Security Policy enforcement, webmail sanitization, proxy rewriting, and privacy controls. The project highlights cases where opening content may unexpectedly disclose that it was viewed or... -
18
rebroswer-patches
Patches for Puppeteer and Playwright to reduce automation detection
rebrowser-patches is an open source collection of patches designed to improve the stealth capabilities of browser automation frameworks. It focuses primarily on enhancing Puppeteer and Playwright by modifying parts of their source code that may reveal automation activity to websites. Many modern websites rely on bot detection mechanisms that identify automation through behavioral or technical signals, and these patches aim to reduce those detection vectors. -
19
Rybbit
Open-source and privacy-friendly alternative to Google Analytics
...The data model is event-driven, enabling funnels, retention views, and simple user journeys without complex configuration. Because privacy is a first-class goal, it aims to minimize personal data collection and offers a self-host path so you can keep analytics in your own infrastructure. The project ships with a lightweight snippet and a Docker-based deployment, making it quick to trial or roll out. It’s suited to indie products and teams who want actionable signals over exhaustive, high-friction dashboards. -
20
watercrawl
AI-ready web crawler that extracts and structures website content
...WaterCrawl supports customizable extraction rules so users can focus only on relevant elements while ignoring unnecessary page components. WaterCrawl also offers real-time monitoring capabilities, allowing users to track crawling progress, performance metrics, and errors during large data collection jobs. Developers can integrate the tool into applications through a REST API and multiple client SDKs, enabling automated data pipelines and AI data preparation workflows. -
21
Halfrost-Field Frostland
This is the place to blog
Halfrost-Field is a large public “knowledge and blog repository” maintained by a developer who documents a wide variety of computer-science, programming, and machine-learning content — from classic algorithms, ML fundamentals, to system design and broader engineering topics. The repository is structured like a personal technical blog/book: it contains “contents” directories with Markdown-based notes, tutorials and guides. For example, there is a full machine learning course outline... -
22
Geziyor
Blazing fast Go framework for web crawling and data scraping tasks
...Geziyor includes features for managing requests, handling cookies, respecting robots rules, and exporting collected data in multiple formats. With built-in tools for caching, metrics collection, and proxy management, it enables developers to build robust and customizable scraping systems using Go. -
23
Ada Class Library
Ada Class Library - an object orientated library for Ada.
Text search and replace. Scripting (small tool programs). CGI scripts. Execution of external programs (incl. I/O redirection). Garbage Collection. Extendended Booch Components. CD-Recorder -
24
MOFO Linux
A live Linux environment for computing without censorship barriers.
...MOFO Linux is designed for easy usage on home PCs, laptop computers, or workstations, whether installed in internet cafes anywhere the world or on the most modest of home desktop machines. It is a collection of office, multimedia, web browsing, file sharing, and internet messaging applications assisted by a collection of anonymity and anti-censorship tools. MOFO Linux contains Encrypted DNS over HTTPS, OpenVPN, Tor, Freenet, I2P, and other software tools which provide anonymous and / or secure access to the internet and circumvention of state censorship restrictions. -
25
A collection of tools related to the game Myst. Most notably, it can transform MOUL/Myst5/Crowthistle datafiles into POTS datafiles. It also allows you to download and install all the fan-Ages. For details see http://myst.dustbird.net/wiki/Drizzle
