Python crawler and API for downloading JMComic albums and images
pyinfra turns Python code into shell commands
Drop-in replacement for Requests. Automatic HTTP/1.1, HTTP/2, and HTTP
Automagically reverse-engineer REST APIs via capturing traffic
A fast, high-level web crawling and web scraping framework
Convert websites into structured APIs automatically with Python tool
Lightweight Python tool for downloading videos from many platforms
Python HTTP library with thread-safe connection pooling
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
Scrape tweets, profiles, followers and following from Twitter/X
Python crawler for collecting and downloading Sina Weibo user data
Cross platform GUI tool for downloading videos from Bilibili sites
The easiest way to parse and modify URLs in Python
A browser agent with a dynamic, indexed action space
Realtime crawler for COVID-19 outbreak statistics from DXY data
Python crawler to download photos and videos from Tumblr blogs
Easily turn large sets of image urls to an image dataset
Python library for scraping and analyzing online news articles easily
Async Python library in automating Chromium browsers without WebDriver
Alternative Twitter front-end
Vertical novel search engine with unified reading and tracking tools
WSGI HTTP Server for UNIX, fast clients and sleepy applications
Python tool for crawling and extracting structured data from news site
Powerful Python crawler framework for scalable web scraping tasks
An adaptive Web Scraping framework