HTTP Replicator is a general purpose caching proxy server written in python. It reduces bandwidth by merging concurrent downloads and building a local 'replicated' file hierarchy, similar to wget -r. The cache is also accessible through a web interface
License
GNU General Public License version 2.0 (GPLv2)Follow HTTP Replicator
Other Useful Business Software
Cloud tools for web scraping and data extraction
Automate web data collection with cloud tools that handle anti-bot measures, browser rendering, and data transformation out of the box. Extract content from any website, push to vector databases for RAG workflows, or pipe directly into your apps via API. Schedule runs, set up webhooks, and connect to your existing stack. Free tier available, then scale as you need to.
Rate This Project
Login To Rate This Project
User Reviews
-
Rework of code is better, promising. Not need much things to be done to leave project alpha2 stage.