ProxyBroker is an open source Python tool designed to automatically discover and verify public proxy servers from many online sources. It operates asynchronously, allowing it to gather and test large numbers of proxies efficiently while performing multiple checks concurrently. It collects proxy addresses from dozens of providers and evaluates whether they are functional and suitable for use. It supports several proxy protocols, including HTTP, HTTPS, SOCKS4, and SOCKS5, making it flexible for different networking and scraping scenarios. ProxyBroker can filter proxies based on criteria such as anonymity level, response time, country of origin, and DNS blacklist status. In addition to discovering and validating proxies, it can also function as a proxy server that distributes incoming requests across a rotating pool of working proxies. This capability allows users to route traffic through multiple proxies automatically, which can help with tasks.
Features
- Asynchronously finds and checks public proxies from multiple sources
- Supports HTTP, HTTPS, SOCKS4, and SOCKS5 proxy protocols
- Filters proxies by anonymity level, response time, country, and DNSBL status
- Automatically removes duplicate proxies from collected lists
- Can operate as a proxy server with automatic proxy rotation
- Validates proxy support for cookies, referer headers, and POST requests