Web app for Scrapyd cluster management
An adaptive Web Scraping framework
All-in-one Python web reconnaissance tool for fast target analysis
Open source Douyin crawler for collecting and downloading public data
Movie metadata scraper and organizer for media libraries and NFO
This is a public repository containing scrapers
Python crawler to download photos and videos from Tumblr blogs
Kemono Downloader - A cross-platform Python app built with PyQt6
Web crawler that finds hidden web directories without brute force
Distributed web crawler admin platform for spiders management
Distributed Crawler Management Framework Based on Scrapy
Intelligent proxy pool for collecting and managing public proxies
Asynchronous tool for finding and checking public proxy servers
Creating Scrapy scrapers via the Django admin interface
DSTK - DataScience ToolKit for All of Us
Massive SQL injection vulnerability scanner for automated web testing
Finds all the security information for a given domain name