A visual no-code/code-free web crawler/spider
Python & command-line tool to gather text on the Web
Turn entire websites into LLM-ready markdown or structured data
Web app for Scrapyd cluster management
Scraping publicly-accessible Letterboxd data for movie recommendations
dude uncomplicated data extraction: A simple framework
Automate the download of entire Twitch.tv channels
Easy Spider is a distributed Perl Web Crawler Project from 2006
SEO Macroscope is a website scanning tool, to check your website
Ever wanted to download only a part of a Git repository.
Android app for saving webpages for offline reading
Perl Web Scraping Project
WebCollector is an open source web crawler framework based on Java.
Open source Search Engine and Enterprise Search