A fast, high-level web crawling and web scraping framework
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
An adaptive Web Scraping framework
Cross platform GUI tool for downloading videos from Bilibili sites
Powerful Python crawler framework for scalable web scraping tasks
Web Scraping Framework
Scrape tweets, profiles, followers and following from Twitter/X
Collection of Python web scraping scripts for data extraction tasks
The best free open source website change detection and restock service
Async Python library in automating Chromium browsers without WebDriver
Open source Douyin crawler for collecting and downloading public data
Web app for Scrapyd cluster management
Python crawler and API for downloading JMComic albums and images
A tool to scrape images from SimpCity
Scrape job websites into a single spreadsheet with no duplicates.
Multiprocess Selenium crawler for downloading images by keywords
Vertical novel search engine with unified reading and tracking tools
Kemono Downloader - A cross-platform Python app built with PyQt6
Command-line Bilibili video and danmaku downloader with batch support
Simple Python framework for building multithreaded web crawlers
Instagram profile crawler that extracts posts, tags, and stats
Async Python framework for fast and flexible web scraping spiders
Python tool for scraping search engine results from many providers
Advanced toolkit for detecting and exploiting CSRF vulnerabilities
Asynchronous tool for finding and checking public proxy servers