Powerful Python crawler framework for scalable web scraping tasks
Progressive PHP web crawler framework with jQuery-like DOM parsing
An adaptive Web Scraping framework
Vertical novel search engine with unified reading and tracking tools
Lightweight cross-platform desktop client for managing Mihomo proxies
Open source file indexing & storage analytics powered by Elasticsearch
Open source web scraping system for automated data collection tasks
Python crawler and API for downloading JMComic albums and images
Fast Go CLI tool for downloading videos from many streaming sites
High-level web crawling and scraping framework for Elixir apps
Easy Spider is a distributed Perl Web Crawler Project from 2006
Secure, Peer-to-Peer, Private and Automateable Web Browser
Async Python framework for fast and flexible web scraping spiders
All-in-one reconnaissance and vulnerability scanning toolkit for sites
Advanced toolkit for detecting and exploiting CSRF vulnerabilities
Distributed proxy IP pool for web crawlers using Scrapy and Redis
Lightweight Java web crawler framework with jQuery-style extraction