Python crawler and API for downloading JMComic albums and images
Python scraper based on AI
Async Python library in automating Chromium browsers without WebDriver
A fast, high-level web crawling and web scraping framework
Collection of Python web scraping scripts for data extraction tasks
Python binding to Modest and Lexbor engines
Redis-based components for Scrapy
Multiprocess Selenium crawler for downloading images by keywords
Download and manage Bilibili Manga chapters with GUI downloader
Open-source LLM Friendly Web Crawler & Scraper
Open source Douyin crawler for collecting and downloading public data
Python library for scraping and analyzing online news articles easily
Scrape tweets, profiles, followers and following from Twitter/X
AI-ready web crawler that extracts and structures website content
Vertical novel search engine with unified reading and tracking tools
An adaptive Web Scraping framework
Open source file indexing & storage analytics powered by Elasticsearch
Scraping publicly-accessible Letterboxd data for movie recommendations
Kemono Downloader - A cross-platform Python app built with PyQt6
dude uncomplicated data extraction: A simple framework
Collection of 100+ Python web scraping projects and crawler examples
Web crawler that finds hidden web directories without brute force
Distributed Crawler Management Framework Based on Scrapy
A service daemon to run Scrapy spiders
Using industrial automation techniques for creating web scraping tools