SEO Macroscope is a website scanning tool, to check your website
Ever wanted to download only a part of a Git repository.
Asyncio-based Python framework for building fast web crawling spiders
Perl Web Scraping Project
Android app for saving webpages for offline reading
Massive SQL injection vulnerability scanner for automated web testing
WebCollector is an open source web crawler framework based on Java.
Finds all the security information for a given domain name
Open source Search Engine and Enterprise Search
A web crawler oriented to information security.