Open source file indexing & storage analytics powered by Elasticsearch
Open source enterprise search server for websites, files, and data
Python crawler to download photos and videos from Tumblr blogs
Multiprocess Selenium crawler for downloading images by keywords
Easy Spider is a distributed Perl Web Crawler Project from 2006
All-in-one reconnaissance and vulnerability scanning toolkit for sites
Pixiv crawler userscript for downloading artwork and galleries easily
Finds all the security information for a given domain name