Search Results for "linux proxy scraper" - Page 6
Sort By:
Showing 158 open source projects for "linux proxy scraper"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
KT-Connect
A toolkit for Integrating with your kubernetes dev environment
KtConnect ("Kt" is short for "Kubernetes Toolkit") is a utility tool to help you work with the Kubernetes dev environment more efficiently. Directly Access a remote Kubernetes cluster. KtConnect use ssh-vpn or socks-proxy to access remote Kubernetes cluster networks. Developers can exchange the workload to redirect the requests to a local app. You can create a mesh version service in the local host, and redirect specified workload requests to your local. Expose a local running app to the... -
2
Martian Proxy
Martian is a library for building custom HTTP/S proxies
Martian Proxy is a programmable HTTP proxy designed to be used for testing. Martian is a great tool to use if you want to verify that all (or some subset) of requests are secure. Mock external services at the network layer. Inject headers, modify cookies or perform other mutations of HTTP requests and responses. Verify that pingbacks happen when you think they should. Unwrap encrypted traffic (requires install of CA certificate in browser) By taking advantage of Go cross-compilation, Martian... -
3
Proxy yxorP
Proxy 🦄 .yxorP [v2.1] Plug & Play Stateful SAAS(y), Multi-tenancy
yxorP is a plug-and-play, flat-file application that does not need Composer, PHP CURL, or databases; these are all optional additions that are fully supported. yxorP is intended to act as a proxy that can edit or update the content of multiple websites using a PHAR (PHP archive) binary version of Guzzle, and managed via a user-friendly Cockpit backend (GUI). The incoming request hostname is used to fetch site-specific requirements from the backend, the target website is then retrieved and... -
4
WebTTY
Share a terminal session over WebRTC
WebTTY is a terminal-sharing tool that lets a user share an interactive shell session over WebRTC. It is useful for pair programming, collaborative debugging, remote help, or accessing systems behind NAT without setting up a traditional proxy server. The project includes a command-line workflow and an in-browser client, so a session can be joined through a static web page when needed. It supports custom commands, allowing users to share a shell, a tmux session, or another terminal-based... -
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
5
Hetty
An HTTP toolkit for security research
Hetty is an HTTP toolkit for security research. It aims to become an open-source alternative to commercial software like Burp Suite Pro, with powerful features tailored to the needs of the infosec and bug bounty communities. Machine-in-the-middle (MITM) HTTP proxy, with logs and advanced search. HTTP client for manually creating/editing requests, and replay proxied requests. Intercept requests and responses for manual review (edit, send/receive, cancel) Scope support, to help keep work... -
6
Till
DataHen Till is a companion tool to your existing web scraper
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes. Web scraping is usually easy to get started, especially on a small scale. However, as you try to scale it up, it gets exponentially difficult. Scraping 10,000 records can easily be done with simple web scraper scripts in any programming language, but as you try to scrape... -
7
Trojan-Go
A Trojan proxy written in Go
In the early days, the firewall only intercepted and reviewed outbound traffic, that is,Passive detection. Shadowsoks' encryption protocol design makes the transmitted data package itself have almost no characteristics, and it looks similar to a completely random bitflow, which can indeed effectively bypass GFW in the early days. Contrary to Shadowsoks, Trojan does not use self-defined encryption protocols to hide itself. On the contrary, the clearly characterized TLS protocol (TLS/SSL) is... -
8
Manba
HTTP API Gateway
Manba is a restful API gateway based on HTTP, which can be used as a unified API access layer. Please make sure your Go version is 1.10 or above. Otherwise, undefined "math/rand". Shuffle error will occur when compiling. Traffic Control (on Server or API). Circuit Breaker (on Server or API). Load balance, service discovery, plugin. Routing (Divert Traffic, Duplicate Traffic). API Aggregation. API Argument Check, API Access Control (White and Black List), API Default Return Value, API... -
9
sso
Single sign-on solution for securing internal services
sso — lovingly known as the S.S. Octopus or octoboi — is the authentication and authorization system BuzzFeed developed to provide a secure, single sign-on experience for access to the many internal web apps used by our employees. It depends on Google as its authoritative OAuth2 provider and authenticates users against a specific email domain. Further authorization based on Google Group membership can be required on a per-upstream basis. The main idea behind sso is a "double OAuth2" flow,... -
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
10
NPS
Lightweight, high-performance, powerful intranet penetration proxy
NPS is a lightweight, high-performance, powerful intranet penetration proxy server, with a powerful web management terminal. Comprehensive protocol support, compatible with almost all commonly used protocols, such as tcp, udp, http(s), socks5, p2p, http proxy. Full platform compatibility (linux, windows, macos, Synology, etc.), support installation as a system service simply. Comprehensive control, both client and server control are allowed. -
11
websocketd
Turn any program that uses STDIN/STDOUT into a WebSocket server
websocketd is the WebSocket daemon. It takes care of handling the WebSocket connections, launching your programs to handle the WebSockets, and passing messages between programs and web-browser. If you can run your program from the command line, you can write WebSocket endpoints. Just read incoming text from stdin and write outgoing text to stdout. Messaging is simple. Each inbound WebSocket connection runs your program in a dedicated process. Connections are isolated by process. Available... -
12
CloudBrute
Awesome cloud enumerator
...We discussed this idea of creating a multiple platform cloud brute-force hunter.mainly to find open buckets, apps, and databases hosted on the clouds and possibly app behind proxy servers. Cloud detection (IPINFO API and Source Code) Supports all major providers. Black-Box (unauthenticated). Fast (concurrent), modular and easily customizable, cross Platform (windows, linux, mac), user-agent randomization, proxy randomization (HTTP, Socks5). -
13
V2Ray Core
A platform for building proxies to bypass network restrictions
V2Ray is the core of the Project V platform—a set of network tools for building custom proxy/VPN setups. It supports multiple protocols (VMess, SOCKS, Shadowsocks, HTTP, etc.), advanced routing, dynamic inbound/outbound connections, and is focused on privacy and bypassing censorship. -
14
proxypool
Proxy crawler that aggregates, tests, and serves usable proxy nodes
proxypool is an open source proxy aggregation tool that automatically collects proxy node information from publicly available sources on the internet. It crawls different sources such as Telegram channels, subscription links, and publicly accessible web pages to gather proxy configurations. After collecting these nodes, proxypool processes them by removing duplicates and verifying whether each node is functional. proxypool then provides a usable list of proxy nodes that have passed... -
15
Google Analytics Beacon Analytics
Google Analytics collector-as-a-service (using GA measurement protocol
GA Beacon is a lightweight tracking proxy for pages that can display images but cannot run Google Analytics JavaScript. A page embeds a badge or transparent pixel whose URL identifies the analytics property and a meaningful tracking path. The service receives that image request, generates a visitor identifier, and forwards the hit through the Google Analytics Measurement Protocol. Cookies allow it to distinguish repeat visits without requiring client-side scripts. It can derive paths from... -
16
Overlord
Providing automated and highly available caching service solutions
Overlord is the proxy and cluster management function of Bilibili based on memcache and redis &cluster written in Go language, and is committed to providing automated and highly available caching service solutions. It mainly includes the following components. A lightweight and highly available cache proxy module that supports memcache and redis proxies, which is equivalent to twemproxy. The difference is that it supports redis-cluster and can disguise itself as a cluster mode. Including... -
17
YouTubeCrawler
Go-based automation utility that downloads YouTube videos
...The architecture follows a command-pattern setup: tasks implement a common interface and are scheduled and executed with concurrency controls (maximum goroutines customizable). It assumes a Linux environment with SSR proxy support, and requires the user to pre-install youtube-dl and ffmpeg. With its focus on automation, the tool is useful for easily archiving multilingual subtitles, prepping content for editing, or creating reference versions of YouTube videos. -
18
armor
Uncomplicated, modern HTTP server
Uncomplicated, modern HTTP server. Serve HTTP/2. Automatically install TLS certificates from https://letsencrypt.org. Proxy HTTP and WebSocket requests. Define virtual hosts with path level routing. Graceful shutdown. Limit request body. Serve static files. Log requests. Gzip response. Cross-origin Resource Sharing (CORS). Security, XSSProtection. ContentTypeNosniff. ContentSecurityPolicy. HTTP Strict Transport Security (HSTS). Add/Remove trailing slash from the URL with the option to redirect. -
19
Kafka-Pixy
gRPC/REST proxy for Kafka
Kafka-Pixy is a dual API (gRPC and REST) proxy for Kafka with automatic consumer group control. It is designed to hide the complexity of the Kafka client protocol and provide a stupid simple API that is trivial to implement in any language. Kafka-Pixy is tested against Kafka versions 1.1.1 and 2.3.0, but is likely to work with any version starting from 0.8.2.2. It uses the Kafka Offset Commit/Fetch API to keep track of consumer offsets. However Group Membership API is not yet implemented,... -
20
Venom
A Multi-hop Proxy for Penetration Testers
Venom is a Go-based multi-hop proxy tool designed for authorized penetration testing, red-team labs, and security education. It helps operators connect multiple nodes and use them as stepping stones for routing traffic across segmented internal networks. The project uses an admin-and-agent architecture, allowing the controller to manage connected nodes and build proxy chains. Venom is useful for studying pivoting, internal routing, SOCKS proxying, and controlled traffic relay in lab or... -
21
BDS
Blockchain data parsing and persisting results
JD Cloud Blockchain Data Service (BDS) is a real-time data aggregating, analyzing, and visualization service for chain-like unstructured data from all kinds of 3rd party Blockchains. Splitter is the key module of Blockchain Data Service (BDS) and provides data analysis capability. Splitter is responsible for consuming blockchain data from message queue (kafka) and inserting data into persistent data storage services (relational database, data warehouse, etc.) for further processing. Before... -
22
Gzip Handler
Go middleware to gzip HTTP responses
This is a tiny Go package that wraps HTTP handlers to transparently gzip the response body, for clients which support it. Although it's usually simpler to leave that to a reverse proxy (like nginx or Varnish), this package is useful when that's undesirable. Call GzipHandler with any handler (an object which implements the http.Handler interface), and it'll return a new handler which gzips the response. -
23
WSDL to Go
WSDL2Go code generation as well as its SOAP proxy
Generates Go code from a WSDL file. Generate idiomatic Go code as much as possible. Support only Document/Literal wrapped services, which are WS-I compliant. Supports XML, Schema 1.0, SOAP 1.1. Resolve external XML Schemas. Support external and local WSDL. -
24
Firefly
A proxy software to help circumventing the Great Firewall
Firefly is an agent used to access Great Firewall (GFW) blocked websites and applications. Under the default settings, Firefly only goes through VPN forwarding wall of IP traffic, IP wall straight. If you find a website or application you cannot access, Firefly flow mechanism can be built to distinguish between an error. In this case, you can choose to forward all traffic through the VPN, and then try again. -
25
GSnova
Private proxy solution & network troubleshooting tool
GSnova is a high-performance proxy tool for bypassing internet censorship and securing network traffic through a range of supported transport protocols. It acts as a multi-protocol client/server proxy that can tunnel traffic over TLS, WebSocket, KCP, QUIC, and SSH. GSnova is optimized for resilience and speed under restrictive network conditions and supports multiple fronting strategies and obfuscation techniques. It's particularly suited for users in highly censored environments and...
