Distributed Crawler Management Framework Based on Scrapy
Descubre archivos, rutas escondidas realizando busquedas avanzadas
A service daemon to run Scrapy spiders
Web crawler for archiving and backing up sites into WARC archives
ML-based HTML scraper that learns extraction rules from examples
Automated mobile app crawler and testing tool built on Appium
All-in-one reconnaissance and vulnerability scanning toolkit for sites
Proxy crawler that aggregates, tests, and serves usable proxy nodes
Python tool for scraping search engine results from many providers
Allows you to download youtube videos into a video/audio format.
Asynchronous tool for finding and checking public proxy servers
SEO Macroscope is a website scanning tool, to check your website
WebExtractServer use with WebExtractLte for use with web browsers
Pixiv crawler userscript for downloading artwork and galleries easily
Convert websites into structured APIs automatically with Python tool
Python tool that automates JD.com login and product purchase tasks
Website crawler that audits site pages automatically with Lighthouse
Android app for saving webpages for offline reading
Massive SQL injection vulnerability scanner for automated web testing
Finds all the security information for a given domain name
anonymous tools [uncontinued]
A web crawler oriented to information security.