Collection of JS reverse engineering examples for web scraping study
Python crawler to download photos and videos from Tumblr blogs
Python crawler for collecting and downloading Sina Weibo user data
Python crawler and API for downloading JMComic albums and images
Realtime crawler for COVID-19 outbreak statistics from DXY data
Powerful Python crawler framework for scalable web scraping tasks
Open-source LLM Friendly Web Crawler & Scraper
Multiprocess Selenium crawler for downloading images by keywords
Open source Douyin crawler for collecting and downloading public data
Convert websites into structured APIs automatically with Python tool
Asyncio-based Python framework for building fast web crawling spiders
A Bulk Domain Assessment Tool
AI-ready web crawler that extracts and structures website content
All-in-one Python web reconnaissance tool for fast target analysis
Python tool for crawling and extracting structured data from news site
Open source file indexing & storage analytics powered by Elasticsearch
Collection of Python web scraping scripts for data extraction tasks
Python crawler proxy IP pool (proxy pool)
Distributed Crawler Management Framework Based on Scrapy
Distributed web crawler admin platform for spiders management
Web crawler that finds hidden web directories without brute force
Web crawler for archiving and backing up sites into WARC archives
Python library providing APIs for automated website login workflows
Simple Python framework for building multithreaded web crawlers
Instagram profile crawler that extracts posts, tags, and stats