Search Results for "linux proxy scraper" - Page 5
Sort By:
Showing 712 open source projects for "linux proxy scraper"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
Pangolin
Identity-Aware Tunneled Reverse Proxy Server with Dashboard UI
Pangolin is an open-source, self-hosted tunneled reverse proxy server that brings identity-aware access control and dashboard management to exposing private services securely. It allows you to connect applications and resources behind firewalls or NATs to a central hub, using encrypted tunnels rather than opening public ports or relying entirely on VPNs. With Pangolin you can route traffic from across distributed networks, enforce contextual access rules (such as SSO, geolocation, time of... -
2
ArgoX
Argo Xray for VPS one-click script
ArgoX is a shell-based deployment project for setting up Xray proxy services with Cloudflare Argo Tunnel support on VPS environments. It focuses on one-click installation and interactive configuration, making it easier to deploy a multi-protocol proxy stack without manually assembling every component. The project supports several protocol options, including VLESS, VMess, Trojan, Shadowsocks, Hysteria2, Reality, WebSocket, gRPC, and XHTTP-based modes. ArgoX uses Cloudflare tunnel behavior to... -
3
Chisel
A fast TCP/UDP tunnel over HTTP
Chisel is a lightweight tunneling tool designed to move TCP and UDP traffic through HTTP while securing the connection with SSH. It packages both client and server functionality into a single Go-based executable, which makes it practical for fast deployment across different environments. The project is especially useful when direct network access is restricted but HTTP or HTTPS traffic is still allowed. It can expose internal services, create secure endpoints, and support reverse forwarding... -
4
Tyk API Gateway
Open Source API Gateway written in Go
Tyk is an open source Enterprise API Gateway, supporting REST, GraphQL, TCP and gRPC protocols. Tyk Gateway is provided ‘Batteries-included’, with no feature lockout. Enabling your organization to control who accesses your APIs, when they access, and how they access it. Tyk Technologies uses the same API Gateway for all it’s applications. Protecting, securing, and processing APIs for thousands of organizations and businesses around the world. Ideal for Open Banking, building software... -
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
5
tumblr-crawler
Python crawler to download photos and videos from Tumblr blogs
tumblr-crawler is an open source Python-based utility designed to download media content from Tumblr blogs. It provides a script that automatically retrieves photos and videos from specified Tumblr sites and saves them locally for offline access. Users can specify one or multiple blogs to crawl by editing a configuration file or by passing parameters through the command line. Once executed, the script fetches media from the Tumblr API and stores the downloaded files in folders named after... -
6
Zapret
Advanced open source tool for bypassing DPI-based censorship
...It supports deployment on a variety of operating systems including traditional Linux systems, embedded devices like routers running OpenWRT, and has partial support for FreeBSD, OpenBSD, macOS, and Windows. -
7
NextDNS
NextDNS CLI client (DoH Proxy)
NextDNS protects you from all kinds of security threats, blocks ads and trackers on websites and in apps and provides a safe and supervised Internet for kids, on all devices and on all networks. Determine your threat model and fine-tune your security strategy by enabling 10+ different types of protections. Use the most trusted threat intelligence feeds containing millions of malicious domains, all updated in real-time. Go beyond the domain, we analyze DNS questions and answers on-the-fly (in... -
8
Ulixee Hero
The web browser built for scraping
It's the first modern headless browsers designed specifically for scraping instead of just automated testing. Hero provides access to the W3C DOM specification without the need for Puppeteer's complicated evaluate callbacks and multi-context switching. We've recreated a fully compliant DOM directly in NodeJS allowing you bypass the headaches of previous scraper tools. The powerful Chrome engine sits under the hood, allowing for lightning fast rendering. Emulators make it easy to disguise... -
9
MDCx
Movie metadata scraper and organizer for media libraries and NFO
MDCx is an open source media metadata scraping and organization tool designed to automate the process of collecting detailed information for movie files. It retrieves metadata from multiple online sources and applies it to local media collections, helping users maintain structured and well-organized libraries. MDCx can download information such as titles, cast data, artwork, and other metadata, then generate standardized NFO files compatible with media management systems. It also supports... -
Stop vibe-debugging.AppSignal's MCP server hands Claude, Cursor, or Zed your real errors, traces, and the deploy that shipped them. AI writes the fix; you review the diff.
-
10
Blocky
Fast and lightweight DNS proxy as ad-blocker for local network
Blocky is a fast, lightweight DNS proxy and network-wide ad blocker designed for home labs and small networks that want Pi-hole-like filtering with more flexible DNS routing and modern protocol support. It blocks DNS queries using external deny lists while also supporting allow lists, and it can scope policies by client groups so different devices or households can have different rulesets. Unlike a single-purpose blocker, it supports advanced DNS behavior such as conditional forwarding and... -
11
paqet
Ferries Packets Across Forbidden Boundaries
paqet is a bidirectional packet-level proxy that transports traffic over raw packets instead of relying on the host operating system’s normal TCP/IP stack. It forwards traffic between a local client and a remote server using KCP as the reliable transport layer. The project is written in Go and is aimed at users who need a low-level tunnel that can operate in restricted or heavily filtered network environments. It is described as an alpha-stage tool, so compatibility and protocol behavior may... -
12
Ligolo-ng
An advanced, yet simple, tunneling/pivoting tool
Ligolo-ng is a simple, lightweight and fast tool that allows pentesters to establish tunnels from a reverse TCP/TLS connection using a tun interface (without the need of SOCKS). When running the relay/proxy server, a tun interface is used, packets sent to this interface are translated and then transmitted to the agent's remote network. You need to download the Wintun driver (used by WireGuard) and place the wintun.dll in the same folder as Ligolo. You can listen to ports on the agent and... -
13
go-mitmproxy
mitmproxy implemented with golang
go-mitmproxy is a Golang implementation of mitmproxy that supports man-in-the-middle attacks and parsing, monitoring, and tampering with HTTP/HTTPS traffic. Parses HTTP/HTTPS traffic and displays traffic details via a web interface. Supports a plugin mechanism for easily extending functionality. Various event hooks can be found in the examples directory. HTTPS certificate handling is compatible with mitmproxy and stored in the ~/.mitmproxy folder. If the root certificate is already trusted... -
14
goclone
Fast CLI tool for cloning entire websites for local browsing offline
goclone is a command-line utility designed to download and mirror complete websites to a local directory for offline access. It retrieves HTML pages, stylesheets, JavaScript files, images, and other assets from a target site and stores them on the user’s computer. It preserves the original site’s structure by maintaining relative links between pages, allowing the mirrored copy to function similarly to the live version when opened locally. Once a site has been cloned, users can browse the... -
15
Cntlm is an NTLM / NTLMv2 authenticating HTTP/1.1 proxy. It caches auth'd connections for reuse, offers TCP/IP tunneling (port forwarding) thru parent proxy and much much more. It's in C, very fast and resource-efficient. Go to http://cntlm.sf.net/
-
16
WIREDOOR
Self hosted ingress-as-a-service platform
WIREDOOR is a self-hosted ingress-as-a-service platform for exposing private, local, or firewalled services to the internet. It uses secure WireGuard tunnels and reverse proxy behavior so internal applications can be reached without directly opening the private network. The platform is designed for users who want cloud-like ingress management while keeping the infrastructure under their own control. Wiredoor can expose HTTP and TCP services and is positioned as a secure way to publish... -
17
piko
An open-source alternative to Ngrok, designed to serve production
Piko is an open-source reverse proxy and tunneling system designed as a self-hostable alternative to ngrok. It lets upstream services open outbound-only connections to Piko, then routes incoming traffic back through those established tunnels. This design is useful for services that are private, behind NAT, firewalled, or otherwise not publicly routable. Piko is built for production-oriented hosting rather than only short-lived development demos. It supports a server and agent model, with the... -
18
urllib3
Python HTTP library with thread-safe connection pooling
urllib3 is a powerful, user-friendly HTTP client for Python. Much of the Python ecosystem already uses urllib3 and you should too. Thread safety, connection pooling. Client-side TLS/SSL verification. File uploads with multipart encoding. Helpers for retrying requests and dealing with HTTP redirects. Support for gzip, deflate, brotli, and zstd encoding. Proxy support for HTTP and SOCKS. 100% test coverage. Professional support for urllib3 is available as part of the Tidelift Subscription.... -
19
on-change
Watch an object or array for changes
Watch an object or array for changes. It works recursively, so it will even detect if you modify a deep property. -
20
Anti-Spam SMTP Proxy Server
Anti-Spam SMTP Proxy Server implements multiple spam filters
The Anti-Spam SMTP Proxy (ASSP) Server project aims to create an open source platform-independent SMTP Proxy server which implements auto-whitelists, self learning Hidden-Markov-Model and/or Bayesian, Greylisting, DNSBL, DNSWL, URIBL, SPF, SRS, Backscatter, Virus scanning, attachment blocking, Senderbase and multiple other filter methods. Click 'Files' to download the professional version 2.8.1 build 24261. -
21
KubeVPN
KubeVPN offers a Cloud Native Dev Environment
KubeVPN is a cloud-native development tool that connects a local machine to a Kubernetes cluster network. It lets developers access cluster resources directly through service names, Pod IPs, or Service IPs, which can make local debugging feel closer to working inside the cluster. The project supports traffic interception so inbound requests for a remote Kubernetes workload can be redirected to a local development process. It can also run a Kubernetes pod locally in Docker while preserving... -
22
websocat
Command-line client for WebSockets, like netcat (or curl)
Netcat, curl and socat for WebSockets. Command-line client for WebSockets, like netcat (or curl) for ws:// with advanced socat-like functions. Connecting to and serving WebSockets from the command line. Executing external program and making it communicate to WebSocket using stdin/stdout. Text and binary modes, converting between lines (or null-terminated records) and messages. Inetd mode, UNIX sockets (including abstract namespaced on Linux). Integration with Nginx using TCP or UNIX sockets.... -
23
Wstunnel
Tunnel all your traffic over Websocket or HTTP2
Wstunnel is a Rust-based tunneling tool that carries arbitrary TCP and UDP traffic over WebSocket or HTTP/2. It is designed to help users reach resources through networks where direct traffic may be blocked, filtered, or difficult to route. Because WebSocket is compatible with regular HTTP infrastructure, wstunnel can work through many reverse proxies, firewalls, and web-oriented network paths. The tool supports client and server modes, static binaries, Docker deployment, reverse tunneling,... -
24
rnet
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
rnet is an ergonomic and modular Python HTTP client designed for developers who need advanced control over network requests and protocol behavior. It provides a flexible API for making HTTP requests while supporting both asynchronous and blocking workflows, allowing it to integrate easily into different Python applications and runtimes. rnet focuses on low-level protocol customization, giving users fine-grained control over TLS and HTTP/2 configuration in order to emulate specific browser... -
25
gain
Asyncio-based Python framework for building fast web crawling spiders
Gain is a Python web crawling framework designed to simplify the process of building efficient and scalable web scrapers. It is built on top of asynchronous technologies such as asyncio, aiohttp, and uvloop to support high-performance crawling with concurrent network requests. It provides a structured framework for creating spiders that can navigate websites, extract structured data, and process the collected results. Developers define crawlers using components such as spiders, parsers, and...
