Python crawler and API for downloading JMComic albums and images
Python & command-line tool to gather text on the Web
Movie metadata scraper and organizer for media libraries and NFO
Python library for scraping and analyzing online news articles easily
High-performance Rust web crawler and scraper for large-scale data
CLI tool to save complete web pages as single self-contained HTML file
The easiest way to parse and modify URLs in Python
Open source Douyin crawler for collecting and downloading public data
Asyncio-based Python framework for building fast web crawling spiders
Progressive PHP web crawler framework with jQuery-like DOM parsing
Open source file indexing & storage analytics powered by Elasticsearch
AI-ready web crawler that extracts and structures website content
Python tool for crawling and extracting structured data from news site
Redis-based components for Scrapy
Collection of Python web scraping scripts for data extraction tasks
High-level web crawling and scraping framework for Elixir apps
ACHE is a web crawler for domain-specific search
ML-based HTML scraper that learns extraction rules from examples
Simple Python framework for building multithreaded web crawlers
Fast and flexible C# framework for building customizable web crawlers
Async Python framework for fast and flexible web scraping spiders
Python crawler that downloads image galleries and analyzes titles
Twitter Intelligence OSINT project performs tracking and analysis
Lightweight Java web crawler framework with jQuery-style extraction