Collection of Python web scraping scripts for data extraction tasks
Python3 web crawler practice
Powerful Python crawler framework for scalable web scraping tasks
Redis-based components for Scrapy
An adaptive Web Scraping framework
Web Scraping Framework
Distributed web crawler admin platform for spiders management
Most Advanced Open Source Intelligence (OSINT) Framework
Async Python framework for fast and flexible web scraping spiders
Python web scanner for OSINT gathering and OWASP vulnerability fuzzing
Incredibly fast crawler designed for OSINT
A powerful Spider(Web Crawler) system in Python
Asyncio-based Python framework for building fast web crawling spiders
The PySolFC Project translated to french
Modular web site spider for web developers.
Enumeration and automation of file discovery for your sec tools.
Player spider for Starcraft 2 battle.net data
Moved to https://github.com/aikinci/monkeyspider