Easily turn large sets of image urls to an image dataset
Blazing fast Go framework for web crawling and data scraping tasks
AWStats Log Analyzer
Web crawler that finds hidden web directories without brute force
Headless Chrome crawler for collecting URLs for vulnerability scans
Make robots for MediaWiki-powered sites!