Lightweight Ruby DSL for scraping structured data from web pages
Convert websites into structured APIs automatically with Python tool
AI-ready web crawler that extracts and structures website content
Open source file indexing & storage analytics powered by Elasticsearch
An adaptive Web Scraping framework
Python crawler and API for downloading JMComic albums and images
Lightweight .NET framework for fast web crawling and data scraping
Web crawler that finds hidden web directories without brute force
Fast and flexible C# framework for building customizable web crawlers