Web app for Scrapyd cluster management
Async Python library in automating Chromium browsers without WebDriver
Cross platform GUI tool for downloading videos from Bilibili sites
A fast, high-level web crawling and web scraping framework
Movie metadata scraper and organizer for media libraries and NFO
Open source Douyin crawler for collecting and downloading public data
This is the most powerful software taking into account CIS location
Python tool for crawling and extracting structured data from news site
This is a public repository containing scrapers
Python crawler to download photos and videos from Tumblr blogs
Asyncio-based Python framework for building fast web crawling spiders
Vertical novel search engine with unified reading and tracking tools
Convert websites into structured APIs automatically with Python tool
Python crawler for collecting and downloading Sina Weibo user data
Python crawler and API for downloading JMComic albums and images
Realtime crawler for COVID-19 outbreak statistics from DXY data
Finviz analysis python library
Python scraper based on AI
Python binding to Modest and Lexbor engines
Open-source LLM Friendly Web Crawler & Scraper
Collection of JS reverse engineering examples for web scraping study
Python & command-line tool to gather text on the Web
Lightweight Python tool for downloading videos from many platforms
AI-ready web crawler that extracts and structures website content
Easily turn large sets of image urls to an image dataset