All-in-one Python web reconnaissance tool for fast target analysis
An adaptive Web Scraping framework
Remote isolated browser API for security
Fast CLI tool for cloning entire websites for local browsing offline
Movie metadata scraper and organizer for media libraries and NFO
Open source enterprise search server for websites, files, and data
Web app for Scrapyd cluster management
Python crawler to download photos and videos from Tumblr blogs
WebEmailsExtractor - get emails and phones from websites to list
Web crawler that finds hidden web directories without brute force
Distributed Crawler Management Framework Based on Scrapy
Easy Spider is a distributed Perl Web Crawler Project from 2006
Task automation software for accessing and manipulating website data.
Intelligent proxy pool for collecting and managing public proxies
AST-based JavaScript reverse engineering and variable tracing toolkit
All-in-one reconnaissance and vulnerability scanning toolkit for sites
Asynchronous tool for finding and checking public proxy servers
DSTK - DataScience ToolKit for All of Us
Massive SQL injection vulnerability scanner for automated web testing
Finds all the security information for a given domain name
Compile your mobile web pages into mobile aps via build.phonegap.com