An adaptive Web Scraping framework
Fast CLI tool for cloning entire websites for local browsing offline
Open source enterprise search server for websites, files, and data
Movie metadata scraper and organizer for media libraries and NFO
Python crawler to download photos and videos from Tumblr blogs
Web crawler that finds hidden web directories without brute force
Easy Spider is a distributed Perl Web Crawler Project from 2006
Intelligent proxy pool for collecting and managing public proxies
AST-based JavaScript reverse engineering and variable tracing toolkit
All-in-one reconnaissance and vulnerability scanning toolkit for sites
Asynchronous tool for finding and checking public proxy servers
Massive SQL injection vulnerability scanner for automated web testing
Finds all the security information for a given domain name