Open source web scraping system for automated data collection tasks
Progressive PHP web crawler framework with jQuery-like DOM parsing
Open source file indexing & storage analytics powered by Elasticsearch
Small event-delegation library for decoupling event binding and handli
Simple Python framework for building multithreaded web crawlers
Async Python framework for fast and flexible web scraping spiders
All-in-one reconnaissance and vulnerability scanning toolkit for sites
Lightweight Java web crawler framework with jQuery-style extraction
Website crawler that audits site pages automatically with Lighthouse