Web Scraping Framework
A fast, high-level web crawling and web scraping framework
dude uncomplicated data extraction: A simple framework
Open-source LLM Friendly Web Crawler & Scraper
Distributed Crawler Management Framework Based on Scrapy
Distributed web crawler admin platform for spiders management
Creating Scrapy scrapers via the Django admin interface
DSTK - DataScience ToolKit for All of Us
Finds all the security information for a given domain name
A web crawler oriented to information security.