A fast, high-level web crawling and web scraping framework
Fast CLI web crawler for discovering endpoints in modern web apps
Fast Go CLI tool for downloading videos from many streaming sites
An adaptive Web Scraping framework
Lightweight Python tool for downloading videos from many platforms
Open source file indexing & storage analytics powered by Elasticsearch
Fast CLI tool for cloning entire websites for local browsing offline
Blazing fast Go framework for web crawling and data scraping tasks
Lightweight .NET framework for fast web crawling and data scraping
Fast Go-based CLI scanner for running automated search engine dorks
Headless Chrome crawler for collecting URLs for vulnerability scans
Fast and flexible C# framework for building customizable web crawlers
Async Python framework for fast and flexible web scraping spiders
Asyncio-based Python framework for building fast web crawling spiders