A scalable web crawler framework for Java
Free batch downloader for image, wallpaper, video, audio, document,
Distributed web crawler admin platform for spiders management
Automated mobile app crawler and testing tool built on Appium
Lightweight Java web crawler framework with jQuery-style extraction
WebCollector is an open source web crawler framework based on Java.