Distributed Crawler Management Framework Based on Scrapy
Dark Web OSINT Tool
Distributed web crawler admin platform for spiders management
Most Advanced Open Source Intelligence (OSINT) Framework
BotSlayer Community Edition
Python ShadowSocks framework
A powerful Spider(Web Crawler) system in Python
File system crawler and disk space usage software
Modular web site spider for web developers.
Finds all the security information for a given domain name
Enumeration and automation of file discovery for your sec tools.
A web crawler oriented to information security.
Python Web Crawler Library
Moved to https://github.com/aikinci/monkeyspider