Easily turn large sets of image urls to an image dataset
dude uncomplicated data extraction: A simple framework
An extension that allows for hassle-free website citation/referencing.
Easy Spider is a distributed Perl Web Crawler Project from 2006
Automate the download of entire Twitch.tv channels
Open source Search Engine and Enterprise Search
Python Web Crawler Library