A Python library for automating interaction with websites
Web app for Scrapyd cluster management
Easily turn large sets of image urls to an image dataset
Web Scraping Framework
Distributed Crawler Management Framework Based on Scrapy
A service daemon to run Scrapy spiders
Finds all the security information for a given domain name
Compile your mobile web pages into mobile aps via build.phonegap.com
A web crawler oriented to information security.