The web browser built for scraping
Python crawler to download photos and videos from Tumblr blogs
Vertical novel search engine with unified reading and tracking tools
Open source enterprise search server for websites, files, and data
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
Open source file indexing & storage analytics powered by Elasticsearch
An extension that allows for hassle-free website citation/referencing.
dude uncomplicated data extraction: A simple framework
Fast Go-based CLI scanner for running automated search engine dorks
Task automation software for accessing and manipulating website data.
Using industrial automation techniques for creating web scraping tools
Web crawler for archiving and backing up sites into WARC archives
Instagram profile crawler that extracts posts, tags, and stats
Polite concurrent web crawler library for Go with flexible hooks
Python bindings for the Chromium Embedded Framework (CEF)
Python tool for scraping search engine results from many providers
Advanced toolkit for detecting and exploiting CSRF vulnerabilities
GOPA, a spider written in Golang, for Elasticsearch
Python crawler that downloads image galleries and analyzes titles
Python library to crawl and retrieve data from WeChat accounts
A powerful Spider(Web Crawler) system in Python
Python tool that automates JD.com login and product purchase tasks
Massive SQL injection vulnerability scanner for automated web testing
news headline collecting for analysis in determining the category