Python crawler and API for downloading JMComic albums and images
A fast, high-level web crawling and web scraping framework
Convert websites into structured APIs automatically with Python tool
Python tool for crawling and extracting structured data from news site
Drop-in replacement for Requests. Automatic HTTP/1.1, HTTP/2, and HTTP
Python HTTP library with thread-safe connection pooling
Lightweight Python tool for downloading videos from many platforms
Async Python library in automating Chromium browsers without WebDriver
Python crawler for collecting and downloading Sina Weibo user data
Python crawler to download photos and videos from Tumblr blogs
Asyncio-based Python framework for building fast web crawling spiders
pyinfra turns Python code into shell commands
Realtime crawler for COVID-19 outbreak statistics from DXY data
Powerful Python crawler framework for scalable web scraping tasks
Collection of JS reverse engineering examples for web scraping study
Python library for scraping and analyzing online news articles easily
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
Open source Douyin crawler for collecting and downloading public data
Vertical novel search engine with unified reading and tracking tools
WSGI HTTP Server for UNIX, fast clients and sleepy applications
Cross platform GUI tool for downloading videos from Bilibili sites
Open source file indexing & storage analytics powered by Elasticsearch
Alternative Twitter front-end
Easily turn large sets of image urls to an image dataset
Scrape tweets, profiles, followers and following from Twitter/X