Python crawler and API for downloading JMComic albums and images
Web app for Scrapyd cluster management
Collection of Python web scraping scripts for data extraction tasks
Lightweight Python tool for downloading videos from many platforms
Python scraper based on AI
A fast, high-level web crawling and web scraping framework
Finviz analysis python library
A Python library for automating interaction with websites
Python crawler for collecting and downloading Sina Weibo user data
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
Async Python library in automating Chromium browsers without WebDriver
Open source Douyin crawler for collecting and downloading public data
This is the most powerful software taking into account CIS location
Python crawler to download photos and videos from Tumblr blogs
Python tool for crawling and extracting structured data from news site
Python & command-line tool to gather text on the Web
Open-source LLM Friendly Web Crawler & Scraper
Easily turn large sets of image urls to an image dataset
All-in-one Python web reconnaissance tool for fast target analysis
Scrape tweets, profiles, followers and following from Twitter/X
Cross platform GUI tool for downloading videos from Bilibili sites
Python library for scraping and analyzing online news articles easily
This is a public repository containing scrapers
Python binding to Modest and Lexbor engines
Collection of JS reverse engineering examples for web scraping study