Remote isolated browser API for security
A fast, high-level web crawling and web scraping framework
Lighter, faster browser kernel of blink to integrate HTML UI in apps
A scalable web crawler framework for Java
Async Python library in automating Chromium browsers without WebDriver
Distributed Crawler Management Framework Based on Scrapy
Easy Spider is a distributed Perl Web Crawler Project from 2006
Gospider - Fast web spider written in Go
Run headless Chrome/Chromium on AWS Lambda