Distributed web crawler admin platform for spiders management
Distributed Crawler Management Framework Based on Scrapy
Dark Web OSINT Tool
Redis-based components for Scrapy
Most Advanced Open Source Intelligence (OSINT) Framework
BotSlayer Community Edition
Python ShadowSocks framework
Web Scraping Framework
A powerful Spider(Web Crawler) system in Python
File system crawler and disk space usage software
Modular web site spider for web developers.
Finds all the security information for a given domain name
Enumeration and automation of file discovery for your sec tools.
A web crawler oriented to information security.
Python Web Crawler Library
Moved to https://github.com/aikinci/monkeyspider