Multiprocess Selenium crawler for downloading images by keywords
Cerberus Content Management System
dude uncomplicated data extraction: A simple framework
A stress testing tool written in python.
Collection of 100+ Python web scraping projects and crawler examples
Command-line Bilibili video and danmaku downloader with batch support
Web crawler that finds hidden web directories without brute force
Python library providing APIs for automated website login workflows
Flake8 plugin for Vim
Web crawler for archiving and backing up sites into WARC archives
ML-based HTML scraper that learns extraction rules from examples
Simple Python framework for building multithreaded web crawlers
Intelligent proxy pool for collecting and managing public proxies
The Classic Webware for Python
Zenoss - Intelligent IT Operations Management
Instagram profile crawler that extracts posts, tags, and stats
The world's leading open source portal
Educational Python web scraping case collection for many sites