Python crawler and API for downloading JMComic albums and images
Python & command-line tool to gather text on the Web
Movie metadata scraper and organizer for media libraries and NFO
Python library for scraping and analyzing online news articles easily
Open source Douyin crawler for collecting and downloading public data
Python tool for crawling and extracting structured data from news site
The easiest way to parse and modify URLs in Python
Asyncio-based Python framework for building fast web crawling spiders
Open source file indexing & storage analytics powered by Elasticsearch
AI-ready web crawler that extracts and structures website content
Redis-based components for Scrapy
Collection of Python web scraping scripts for data extraction tasks
ML-based HTML scraper that learns extraction rules from examples
Simple Python framework for building multithreaded web crawlers
Async Python framework for fast and flexible web scraping spiders
Python crawler that downloads image galleries and analyzes titles
Twitter Intelligence OSINT project performs tracking and analysis