This is the most powerful software taking into account CIS location
A visual no-code/code-free web crawler/spider
Turn entire websites into LLM-ready markdown or structured data
Web app for Scrapyd cluster management
Scraping publicly-accessible Letterboxd data for movie recommendations
dude uncomplicated data extraction: A simple framework
Python & command-line tool to gather text on the Web
Automate the download of entire Twitch.tv channels
Easy Spider is a distributed Perl Web Crawler Project from 2006
It allows you to input a URL and it will scrape the HTML content...
Yet Another BAsic Scraper and Text Analysis
SEO Macroscope is a website scanning tool, to check your website
Ever wanted to download only a part of a Git repository.
Android app for saving webpages for offline reading
Perl Web Scraping Project
DSTK - DataScience ToolKit for All of Us
A Python class to allow the user to automate Internet Explorer
WebCollector is an open source web crawler framework based on Java.
Open source Search Engine and Enterprise Search
Generate wordlists using different methods
A web crawler oriented to information security.