Redis-based components for Scrapy
A fast, high-level web crawling and web scraping framework
Distributed Crawler Management Framework Based on Scrapy
A service daemon to run Scrapy spiders
The complete web scraping toolkit for PHP
Web app for Scrapyd cluster management
Distributed web crawler admin platform for spiders management
Linux for content creation, web scraping, coding, and data analysis.
Creating Scrapy scrapers via the Django admin interface
A powerful Spider(Web Crawler) system in Python