Progressive PHP web crawler framework with jQuery-like DOM parsing
Powerful Python crawler framework for scalable web scraping tasks
Desktop tool for downloading media from many social platforms
Open source file indexing & storage analytics powered by Elasticsearch
Vertical novel search engine with unified reading and tracking tools
An adaptive Web Scraping framework
Lightweight cross-platform desktop client for managing Mihomo proxies
Open source web scraping system for automated data collection tasks
Python crawler and API for downloading JMComic albums and images
This is a public repository containing scrapers
Declarative web scraping
Fast Go CLI tool for downloading videos from many streaming sites
A universal web-util for PHP
Free batch downloader for image, wallpaper, video, audio, document,
High-level web crawling and scraping framework for Elixir apps
Easy Spider is a distributed Perl Web Crawler Project from 2006
Secure, Peer-to-Peer, Private and Automateable Web Browser
Async Python framework for fast and flexible web scraping spiders
All-in-one reconnaissance and vulnerability scanning toolkit for sites
Advanced toolkit for detecting and exploiting CSRF vulnerabilities
An Android rich text class library that supports graphic & text mixing
Distributed proxy IP pool for web crawlers using Scrapy and Redis
Lightweight Java web crawler framework with jQuery-style extraction
PHP multiprocess web crawling framework with distributed support
Compile your mobile web pages into mobile aps via build.phonegap.com