Python & command-line tool to gather text on the Web
Redis-based components for Scrapy
Twitter for Python
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
Changelog CI is a GitHub Action that enables a project
Automated nginx proxy for Docker containers using docker-gen
Web app for Scrapyd cluster management
Prevent cloud misconfigurations during build-time for Terraform
Utilize all available CPU cores for accepting new client connections
Automatically mock your HTTP interactions to simplify testing
Command line tool to modify OS X's accessibility database (TCC.db)
Scraping publicly-accessible Letterboxd data for movie recommendations
Scrape job websites into a single spreadsheet with no duplicates.
A central control plane for AWS permissions and access
Rules engine for cloud security, cost optimization, and governance
Static site generator that supports Markdown and reST syntax
Python package for doing RPA
A simple WebSocket server
Modern, privacy-friendly, and detailed web analytics
Distributed web crawler admin platform for spiders management
Distributed Crawler Management Framework Based on Scrapy
A library that scrapes Linkedin for user data
Portable software for cloud, local, and portable USB drives
Get your public IP Address on the Command Line
Download videos/channels/playlists from YouTube and many other sites