Cross platform GUI tool for downloading videos from Bilibili sites
A fast, high-level web crawling and web scraping framework
Open source web scraping system for automated data collection tasks
Vertical novel search engine with unified reading and tracking tools
Fast CLI web crawler for discovering endpoints in modern web apps
Lightweight cross-platform desktop client for managing Mihomo proxies
An adaptive Web Scraping framework
Open source Douyin crawler for collecting and downloading public data
Lightweight Python tool for downloading videos from many platforms
Open source enterprise search server for websites, files, and data
Python crawler to download photos and videos from Tumblr blogs
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
Python crawler and API for downloading JMComic albums and images
Powerful Python crawler framework for scalable web scraping tasks
Scrape tweets, profiles, followers and following from Twitter/X
Fast CLI tool for cloning entire websites for local browsing offline
High-performance Rust web crawler and scraper for large-scale data
Movie metadata scraper and organizer for media libraries and NFO
Async Python library in automating Chromium browsers without WebDriver
CLI tool to save complete web pages as single self-contained HTML file
AI-ready web crawler that extracts and structures website content
Easily turn large sets of image urls to an image dataset
Collection of JS reverse engineering examples for web scraping study
Patches for Puppeteer and Playwright to reduce automation detection
Collection of reverse engineering articles curated for learning