Realtime crawler for COVID-19 outbreak statistics from DXY data
Python crawler for collecting and downloading Sina Weibo user data
AI-ready web crawler that extracts and structures website content
A tool to scrape images from SimpCity
An adaptive Web Scraping framework
All-in-one Python web reconnaissance tool for fast target analysis
Scraping publicly-accessible Letterboxd data for movie recommendations
Download and manage Bilibili Manga chapters with GUI downloader
Web crawler that finds hidden web directories without brute force
Distributed Crawler Management Framework Based on Scrapy
Web crawler for archiving and backing up sites into WARC archives
Instagram profile crawler that extracts posts, tags, and stats
Asynchronous tool for finding and checking public proxy servers