Python crawler and API for downloading JMComic albums and images
A fast, high-level web crawling and web scraping framework
Drop-in replacement for Requests. Automatic HTTP/1.1, HTTP/2, and HTTP
Convert websites into structured APIs automatically with Python tool
Python HTTP library with thread-safe connection pooling
Python tool for crawling and extracting structured data from news site
Lightweight Python tool for downloading videos from many platforms
Python crawler to download photos and videos from Tumblr blogs
Python crawler for collecting and downloading Sina Weibo user data
Asyncio-based Python framework for building fast web crawling spiders
pyinfra turns Python code into shell commands
Async Python library in automating Chromium browsers without WebDriver
Realtime crawler for COVID-19 outbreak statistics from DXY data
Powerful Python crawler framework for scalable web scraping tasks
Open source Douyin crawler for collecting and downloading public data
Python library for scraping and analyzing online news articles easily
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
Vertical novel search engine with unified reading and tracking tools
Cross platform GUI tool for downloading videos from Bilibili sites
WSGI HTTP Server for UNIX, fast clients and sleepy applications
Open source file indexing & storage analytics powered by Elasticsearch
Easily turn large sets of image urls to an image dataset
Collection of JS reverse engineering examples for web scraping study
Alternative Twitter front-end
Movie metadata scraper and organizer for media libraries and NFO