Fast CLI web crawler for discovering endpoints in modern web apps
Lightweight Ruby DSL for scraping structured data from web pages
Open source enterprise search server for websites, files, and data
AI-ready web crawler that extracts and structures website content
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
Advanced toolkit for detecting and exploiting CSRF vulnerabilities
The easiest way to parse and modify URLs in Python
Python tool for crawling and extracting structured data from news site
Secure, Peer-to-Peer, Private and Automateable Web Browser
Intelligent proxy pool for collecting and managing public proxies
Automated mobile app crawler and testing tool built on Appium
Fast and flexible C# framework for building customizable web crawlers
Educational Python web scraping case collection for many sites
AST-based JavaScript reverse engineering and variable tracing toolkit
All-in-one reconnaissance and vulnerability scanning toolkit for sites
Python library to crawl and retrieve data from WeChat accounts
Lightweight Java web crawler framework with jQuery-style extraction
Massive SQL injection vulnerability scanner for automated web testing
Open source Search Engine and Enterprise Search