Search Results for "linux proxy scraper"
Sort By:
Showing 297 open source projects for "linux proxy scraper"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
1
Proxy
Proxy: Next Generation Polymorphism in C++
For decades, object-based virtual tables have been a de facto implementation of runtime polymorphism in many (compiled) programming languages. There are many drawbacks in this mechanism, including life management (because each object may have a different size and ownership) and reflection (because it is hard to balance between usability and memory allocation). To workaround these drawbacks, some languages like Java or C# choose to sacrifice performance by introducing GC to facilitate... -
2
shot-scraper
A command-line utility for taking automated screenshots of websites
shot-scraper is a command-line utility for taking automated screenshots of web pages using a headless browser engine. After installation, a single command can capture a full-page screenshot of a URL and save it to a file, making it ideal for documentation, monitoring, and visual regression tasks. Under the hood it uses a modern browser (installed via a one-time shot-scraper install step) and exposes options for viewport size, full-page versus clipped screenshots, and device emulation. Beyond... -
3
soup
Web Scraper in Go, similar to BeautifulSoup
Web Scraper in Go, similar to BeautifulSoup. soup is a small web scraper package for Go, with its interface highly similar to that of BeautifulSoup. Pointer containing the pointer to the current html node. NodeValue containing the current html node's value, i.e. the tag name for an ElementNode, or the text in case of a TextNode. Error containing an error in a struct if one occurs, else nil is returned. A detailed text explanation of the error can be accessed using the Error() function. A... -
4
NGINX Proxy Manager
Docker container for managing Nginx proxy hosts
Expose web services on your network. Free SSL with Let's Encrypt. Designed with security in mind. Perfect for home networks. Expose your private network Web services and get connected anywhere. Based on Tabler, the interface is a pleasure to use. Configuring a server has never been so fun. Configure other users to either view or manage their own hosts. Full access permissions are available. Built as a Docker Image, Nginx Proxy Manager only requires a database. Built in Let’s Encrypt support... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
NekoBox for PC (NekoRay)
Qt based cross-platform GUI proxy configuration manager
NekoBox for PC is a Qt-based, cross-platform proxy configuration manager designed for Windows and Linux systems. It provides a user-friendly graphical interface for managing advanced proxy and tunneling configurations using the sing-box backend. NekoBox supports a wide range of modern proxy protocols, making it suitable for users who need flexible and powerful network routing options. -
6
Tun2Socks
tun2socks , powered by gVisor TCP/IP stack
Proxy Everything: Handle all network traffic of any internet programs sent by the device through a proxy. Proxy Protocols: HTTP/Socks4/Socks5/Shadowsocks with authentication support for remote connections. Run Everywhere. Linux/macOS/Windows/FreeBSD/OpenBSD multi-platform support with specific optimization. Gateway Mode: Act as a layer three gateway to handle network traffic from other devices in the same network. -
7
Envoy Gateway
Manages Envoy Proxy as a Standalone or Kubernetes-based Gateway
Envoy Gateway is an open source project for managing Envoy Proxy as a standalone or Kubernetes-based application gateway. Based on Gateway API, with reasonable default settings to simplify the Envoy user experience, without knowing details of Envoy proxy. Automatically Envoy infrastructure provisioning and management. Support for heterogeneous environments. Initially, Kubernetes will receive the most focus. Vendors will have the ability to provide value-added products built on the Envoy... -
8
iOS WebKit Debug Proxy
A DevTools proxy for iOS devices
The ios_webkit_debug_proxy (aka iwdp) proxies requests from usbmuxd daemon over a websocket connection, allowing developers to send commands to MobileSafari and UIWebViews on real and simulated iOS devices. iOS WebKit Debug Proxy works on Linux, MacOS & Windows. The iOS Simulator is supported, but it must be started before the proxy. The simulator can be started in XCode, standalone, or via the command line. ios_webkit_debug_proxy can be used with many tools such as Chrome DevTools and Safari Web Inspector. To use Chrome DevTools it's the recommendation to use the RemoteDebug/remotedebug-ios-webkit-adapter project, which has instructions on how to setup Chrome to remote debug iOS devices, much similar to Android debugging. ... -
9
clash-rules
Clash Premium rule set (RULE-SET), compatible with ClashX Pro
clash-rules is a repository that provides rule sets and configuration files designed for proxy tools and systems like V2Ray / Clash — helping users to decide routing, blocking, or proxy behavior based on domain, IP, or other criteria. The repo aggregates many community-maintained lists: blocked domains, direct access lists, proxy-needed domains, geo-IP lists, and more — offering up-to-date and curated configuration data that reflects network conditions, censorship lists, or desirable routing... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
v2ray-rules-dat
V2Ray routing rules file enhanced version, which can replace V2Ray
v2ray-rules-dat is a repository that compiles and distributes enhanced rule data (domain lists, geo-IP/geo-domain data, block/proxy/detect lists) intended for use with tools like V2Ray, Xray-core, and similar network/proxy frameworks. The dataset serves as an alternative or supplement to official geoip/ geosite data files, often providing more up-to-date, community-curated entries — enabling better routing, blocking, or traffic management when using those proxy tools. The repository is... -
11
Traefik
An open-source reverse proxy and load balancer
Traefik (pronounced traffic) is a modern HTTP reverse proxy and load balancer that makes deploying microservices easy. Traefik integrates with your existing infrastructure components (Docker, Swarm mode, Kubernetes, Marathon, Consul, Etcd, Rancher, Amazon ECS, ...) and configures itself automatically and dynamically. Pointing Traefik at your orchestrator should be the only configuration step you need. -
12
dev-sidecar
dev-sidecar Git release
The developer sidecar, named service-sidecar from service-mesh, means an auxiliary sidecar tool (hereinafter referred to as ds) for developers to proxy HTTP requests to some domestic acceleration channels through local proxy. Intelligently resolve the best domain name IP address according to network conditions to obtain the best network speed. Solve the problem that some websites and libraries are inaccessible or slow. It is recommended that if you encounter a slow-opening foreign website,... -
13
ZAP
The OWASP ZAP core project
The OWASP Zed Attack Proxy (ZAP) is one of the world’s most popular free security tools and is actively maintained by a dedicated international team of volunteers. It can help you automatically find security vulnerabilities in your web applications while you are developing and testing your applications. It's also a great tool for experienced pentesters to use for manual security testing. ZAP is an easy to use integrated penetration testing tool for finding vulnerabilities in web... -
14
Node.js HTTP Proxy Agents Monorepo
Node.js HTTP Proxy Agents Monorepo
Proxy Agents is a Node.js monorepo containing HTTP agent implementations for routing requests through proxy servers. Its high-level proxy-agent package automatically selects the correct agent from standard environment variables such as HTTP_PROXY, HTTPS_PROXY, and NO_PROXY. Lower-level packages provide dedicated support for HTTP, HTTPS, SOCKS, and PAC-based proxy configurations. An LRU cache reuses compatible agent instances across requests to reduce repeated setup work. The repository also... -
15
RtspSimpleServer
ready-to-use RTSP / RTMP / LL-HLS / WebRTC server and proxy
rtsp-simple-server is a ready-to-use and zero-dependency server and proxy that allows users to publish, read and proxy live video and audio streams. Publish live streams to the server Read live streams from the server. Proxy streams from other servers or cameras, always or on-demand. Streams are automatically converted from a protocol to another. For instance, it's possible to publish a stream with RTSP and read it with HLS. -
16
Fabio
Consul Load-Balancing made simple
Fabio is an HTTP and TCP reverse proxy that configures itself with data from Consul. Traditional load balancers and reverse proxies need to be configured with a config file. The configuration contains the hostnames and paths the proxy is forwarding to upstream services. This process can be automated with tools like consul-template that generate config files and trigger a reload. Fabio works differently since it updates its routing table directly from the data stored in Consul as soon as... -
17
YARP
A toolkit for developing high-performance HTTP reverse proxy apps
YARP is a library to help create reverse proxy servers that are high-performance, production-ready, and highly customizable. We found a bunch of internal teams at Microsoft who were either building a reverse proxy for their service or had been asking about APIs and tech for building one, so we decided to get them all together to work on a common solution, this project. Each of these projects was doing something slightly off the beaten path which meant they were not well served by existing... -
18
docker-gen
Generate files from docker container meta-data
docker-gen is a file generator that renders templates using docker container meta-data. Centralized logging - fluentd, logstash or other centralized logging tools that tail the containers JSON log file or files within the container. Log Rotation - logrotate files to rotate container JSON log files. Reverse Proxy Configs - nginx, haproxy, etc. reverse proxy configs to route requests from the host to containers. Service Discovery - Scripts (python, bash, etc..) to register containers within... -
19
cc-switch
A cross-platform desktop All-in-One assistant tool for Claude Code
cc-switch is a cross-platform desktop assistant designed to unify and streamline the management of multiple AI coding tools such as Claude Code, Codex, OpenCode, and Gemini CLI within a single interface. The application focuses on improving developer productivity by providing centralized configuration, provider switching, and workflow orchestration across different AI backends. Built as a modern desktop app using Tauri and web technologies, it enables users to manage credentials, sessions,... -
20
Colly
Elegant Scraper and Crawler Framework for Golang
Colly provides a clean interface to write any kind of crawler/scraper/spider. With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving. Clean API. Fast (>1k request/sec on a single core) Manages request delays and maximum concurrency per domain. Automatic cookie and session handling. Sync/async/parallel scraping. Distributed scraping. Caching, automatic encoding of non-unicode... -
21
Cloudflare-Socks5
CF-workers/pages proxy script: supports Vless-ws (tls) and Trojan-ws
Cloudflare-Socks5 is a proxy deployment toolkit designed to leverage Cloudflare Workers and Pages to create flexible, censorship-resistant proxy nodes using protocols such as VLESS and Trojan. The project provides scripts that enable users to deploy proxy services locally without relying on external subscription providers, improving privacy and control over configuration data. It supports multiple transport modes including WebSocket with TLS, as well as optional encrypted handshake... -
22
ProxyAdmin
Proxy is a high-performance, full-function http proxy, https proxy
ProxyAdmin Free is a web-based management console for the goproxy networking and proxy server. It provides a graphical alternative to managing goproxy entirely through command-line arguments. Administrators can configure HTTP and HTTPS proxies, SOCKS5 services, internal network tunneling, and other supported proxy modes. The interface also exposes remote-access features such as VNC and Web-SSH alongside custom service configuration. -
23
warp-yg
Warp multi-function one-click script, supports warp-go and wgcf
warp-yg is a script-based toolkit designed to automate the deployment and optimization of Cloudflare WARP networking configurations for enhanced privacy and performance. It focuses on simplifying the integration of WireGuard-based WARP connections into proxy environments, allowing users to route traffic through optimized Cloudflare endpoints. The project includes functionality for selecting optimal endpoints and improving connection speed by dynamically identifying efficient routes. It is... -
24
GeoIP
This project automatically generates GeoIP files in multiple formats
GeoIP is a community-maintained project that generates and publishes enhanced GeoIP/Geo-database and IP-location/routing data in multiple formats (e.g. V2Ray .dat, MaxMind .mmdb, and others) to support proxy, VPN, or routing tools requiring IP-to-country/region resolution. Rather than depending solely on the official GeoLite2 data, geoip augments and merges data sources (especially for certain regions) to improve coverage or tailor by use-case (e.g. proxy-specific rules, private networks, or... -
25
CFnew
Cloudflare Workers-based proxy deployment project
CFnew is a Cloudflare Workers-based proxy deployment and subscription management project focused on generating optimized client configurations. It supports multiple proxy protocols and lets users manage paths, preferred IPs, and output formats through a more convenient interface. The project stores configuration through Cloudflare KV, which allows changes to take effect without redeploying the worker each time. It includes latency testing tools and automated format detection so different...
