The complete web scraping toolkit for PHP
Python crawler for collecting and downloading Sina Weibo user data
Easily turn large sets of image urls to an image dataset
Open-Source RPA Software (formerly Kantu)
CLI tool to save complete web pages as single self-contained HTML file
Library for Rapid (Web) Crawler and Scraper Development
A web scraping and browser automation library for Node.js
Lighter, faster browser kernel of blink to integrate HTML UI in apps
All-in-one Python web reconnaissance tool for fast target analysis
This is the most powerful software taking into account CIS location
Scraping publicly-accessible Letterboxd data for movie recommendations
Redis-based components for Scrapy
Python crawler to download photos and videos from Tumblr blogs
Scrape job websites into a single spreadsheet with no duplicates.
Kemono Downloader - A cross-platform Python app built with PyQt6
Free batch downloader for image, wallpaper, video, audio, document,
Open-source SERP API for AI, SEO & automation - Google + 5 more
An extension that allows for hassle-free website citation/referencing.
Finds interesting news headlines.
Distributed web crawler admin platform for spiders management
Distributed Crawler Management Framework Based on Scrapy
Task automation software for accessing and manipulating website data.
Easy Spider is a distributed Perl Web Crawler Project from 2006
A service daemon to run Scrapy spiders