Python crawler and API for downloading JMComic albums and images
Command line tool and library for transferring data with URLs
pyinfra turns Python code into shell commands
A fast, high-level web crawling and web scraping framework
Lightweight Python tool for downloading videos from many platforms
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
Async Python library in automating Chromium browsers without WebDriver
Cross platform GUI tool for downloading videos from Bilibili sites
WSGI HTTP Server for UNIX, fast clients and sleepy applications
Convert websites into structured APIs automatically with Python tool
Scrape tweets, profiles, followers and following from Twitter/X
Drop-in replacement for Requests. Automatic HTTP/1.1, HTTP/2, and HTTP
Python HTTP library with thread-safe connection pooling
The easiest way to parse and modify URLs in Python
Alternative Twitter front-end
Easily turn large sets of image urls to an image dataset
Python crawler to download photos and videos from Tumblr blogs
Python crawler for collecting and downloading Sina Weibo user data
Open source Douyin crawler for collecting and downloading public data
Factorio headless server in a Docker container
Python library for scraping and analyzing online news articles easily
Python tool for crawling and extracting structured data from news site
Powerful Python crawler framework for scalable web scraping tasks
Movie metadata scraper and organizer for media libraries and NFO
Collection of JS reverse engineering examples for web scraping study