A fast, high-level web crawling and web scraping framework
Redis-based components for Scrapy
Distributed Crawler Management Framework Based on Scrapy
A service daemon to run Scrapy spiders
Web app for Scrapyd cluster management
Install and manage a high performance WordPress stack
Distributed web crawler admin platform for spiders management
Persistent HTTP cache for python requests
Creating Scrapy scrapers via the Django admin interface
A powerful Spider(Web Crawler) system in Python
A complete multi-language developement stack for GNU/Linux