This is the most powerful software taking into account CIS location
Distributed Crawler Management Framework Based on Scrapy
dude uncomplicated data extraction: A simple framework
Easily turn large sets of image urls to an image dataset
A service daemon to run Scrapy spiders
Scrape job websites into a single spreadsheet with no duplicates.
Distributed web crawler admin platform for spiders management
Redis-based components for Scrapy
Scraping publicly-accessible Letterboxd data for movie recommendations
A powerful Spider(Web Crawler) system in Python
A web crawler oriented to information security.