ACHE is a web crawler for domain-specific search
A visual no-code/code-free web crawler/spider
Goutte, a simple PHP Web Scraper
Internet Archive's open-source, web-scale, web crawler project
A scalable web crawler framework for Java
Lighter, faster browser kernel of blink to integrate HTML UI in apps
Distributed Crawler Management Framework Based on Scrapy
Library for Rapid (Web) Crawler and Scraper Development
Distributed web crawler admin platform for spiders management
The unix-way web crawler
Handy, High performance, ModSecurity compatible Nginx firewall module
The complete web scraping toolkit for PHP
Dark Web OSINT Tool
Free Extracts Emails, Phones and custom text from Web using JAVA Regex
Most Advanced Open Source Intelligence (OSINT) Framework
Easy Spider is a distributed Perl Web Crawler Project from 2006
Free Extracts Emails, Phones and custom text from Web using JAVA Regex
Python bindings for the Chromium Embedded Framework (CEF)
Free batch downloader for image, wallpaper, video, audio, document,
Crawl and download Snap Lenses from lens.snapchat.com with ease.
Task automation software for accessing and manipulating website data.
A PHP search engine for your website and web analytics tool. GNU GPL3
A Simple Demonstration of the New York Times App
create useful statistics and traffic on your site
Distributed high-concurrency crawler software written in pure golang