A fast, high-level web crawling and web scraping framework
This is the most powerful software taking into account CIS location
Cross platform GUI tool for downloading videos from Bilibili sites
Collection of JS reverse engineering examples for web scraping study
Open source Douyin crawler for collecting and downloading public data
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
Python crawler for collecting and downloading Sina Weibo user data
Lightweight Python tool for downloading videos from many platforms
Vertical novel search engine with unified reading and tracking tools
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
An adaptive Web Scraping framework
Open-source LLM Friendly Web Crawler & Scraper
Movie metadata scraper and organizer for media libraries and NFO
Easily turn large sets of image urls to an image dataset
Finviz analysis python library
Python crawler to download photos and videos from Tumblr blogs
Python tool for crawling and extracting structured data from news site
Python scraper based on AI
This is a public repository containing scrapers
Python & command-line tool to gather text on the Web
Web Scraping Framework
Scrape tweets, profiles, followers and following from Twitter/X
Python crawler and API for downloading JMComic albums and images
Async Python library in automating Chromium browsers without WebDriver
Open source file indexing & storage analytics powered by Elasticsearch