Python crawler and API for downloading JMComic albums and images
An adaptive Web Scraping framework
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
Web Scraping Framework
Scrape tweets, profiles, followers and following from Twitter/X
NBA Stats API via Basketball Reference
The best free open source website change detection and restock service
Web app for Scrapyd cluster management
AI-ready web crawler that extracts and structures website content
Open-source LLM Friendly Web Crawler & Scraper
Realtime crawler for COVID-19 outbreak statistics from DXY data
Python crawler to download photos and videos from Tumblr blogs
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
A Python library for automating interaction with websites
Async Python library in automating Chromium browsers without WebDriver
This is a public repository containing scrapers
Collection of JS reverse engineering examples for web scraping study
Python library for scraping and analyzing online news articles easily
dude uncomplicated data extraction: A simple framework
Distributed Crawler Management Framework Based on Scrapy
Distributed web crawler admin platform for spiders management
A service daemon to run Scrapy spiders
Intelligent proxy pool for collecting and managing public proxies
Twitter Intelligence OSINT project performs tracking and analysis