Search Results for "linux proxy scraper" - Page 4
Sort By:
Showing 97 open source projects for "linux proxy scraper"
View related business solutions-
Free CRM Software With Something for EveryoneThink CRM software is just about contact management? Think again. HubSpot CRM has free tools for everyone on your team, and it’s 100% free. Here’s how our free CRM solution makes your job easier.
-
Red Hat Enterprise Linux on Microsoft AzureRed Hat Enterprise Linux (RHEL) on Microsoft Azure provides a secure, reliable, and flexible foundation for your cloud infrastructure. Red Hat Enterprise Linux on Microsoft Azure is ideal for enterprises seeking to enhance their cloud environment with seamless integration, consistent performance, and comprehensive support.
-
1
Trojan-Go
A Trojan proxy written in Go
In the early days, the firewall only intercepted and reviewed outbound traffic, that is,Passive detection. Shadowsoks' encryption protocol design makes the transmitted data package itself have almost no characteristics, and it looks similar to a completely random bitflow, which can indeed effectively bypass GFW in the early days. Contrary to Shadowsoks, Trojan does not use self-defined encryption protocols to hide itself. On the contrary, the clearly characterized TLS protocol (TLS/SSL) is... -
2
sso
Single sign-on solution for securing internal services
... sso-auth is the OAuth2 provider for sso-proxy and Google is the OAuth2 provider for sso-auth. -
3
NPS
Lightweight, high-performance, powerful intranet penetration proxy
NPS is a lightweight, high-performance, powerful intranet penetration proxy server, with a powerful web management terminal. Comprehensive protocol support, compatible with almost all commonly used protocols, such as tcp, udp, http(s), socks5, p2p, http proxy. Full platform compatibility (linux, windows, macos, Synology, etc.), support installation as a system service simply. Comprehensive control, both client and server control are allowed. Https integration, support to convert backend proxy... -
4
websocketd
Turn any program that uses STDIN/STDOUT into a WebSocket server
... for Linux, OSX, Windows, FreeBSD, OpenBSD and Solaris. Serves your static HTML, JavaScript, etc. Route different URLs to different programs. Dynamic generate content over HTTP too. Out-of-the-box support for serving content using HTTPS and WSS. Restrict which pages can make WebSocket connections. Interact with your WebSocket programs before you've built your frontend. -
Payroll Services for Small Businesses | QuickBooksEasily pay your team and access powerful tools, employee benefits, and supportive experts with the #1 online payroll service provider. Manage payroll and access HR and employee services in one place. Pay your team automatically once your payroll setup is complete. We'll calculate, file, and pay your payroll taxes automatically.
-
5
Auto Proxy
supports https and http protocol proxy;
The project provides browser http proxy proxy service, supports https and http protocol proxy; can deploy multi-level proxy; supports TLS protocol encryption; mainly uses tools for accessing external websites with intranet hosts; -
6
CloudBrute
Awesome cloud enumerator
... buckets, apps, and databases hosted on the clouds and possibly app behind proxy servers. Cloud detection (IPINFO API and Source Code) Supports all major providers. Black-Box (unauthenticated). Fast (concurrent), modular and easily customizable, cross Platform (windows, linux, mac), user-agent randomization, proxy randomization (HTTP, Socks5). -
7
Colly
Elegant Scraper and Crawler Framework for Golang
Colly provides a clean interface to write any kind of crawler/scraper/spider. With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving. Clean API. Fast (>1k request/sec on a single core) Manages request delays and maximum concurrency per domain. Automatic cookie and session handling. Sync/async/parallel scraping. Distributed scraping. Caching, automatic encoding of non-unicode responses... -
8
Overlord
Providing automated and highly available caching service solutions
Overlord is the proxy and cluster management function of Bilibili based on memcache and redis &cluster written in Go language, and is committed to providing automated and highly available caching service solutions. It mainly includes the following components. A lightweight and highly available cache proxy module that supports memcache and redis proxies, which is equivalent to twemproxy. The difference is that it supports redis-cluster and can disguise itself as a cluster mode. Including... -
9
BDS
Blockchain data parsing and persisting results
JD Cloud Blockchain Data Service (BDS) is a real-time data aggregating, analyzing, and visualization service for chain-like unstructured data from all kinds of 3rd party Blockchains. Splitter is the key module of Blockchain Data Service (BDS) and provides data analysis capability. Splitter is responsible for consuming blockchain data from message queue (kafka) and inserting data into persistent data storage services (relational database, data warehouse, etc.) for further processing. Before... -
Secure remote access solution to your private network, in the cloud or on-prem.OpenVPN is here to bring simple, flexible, and cost-effective secure remote access to companies of all sizes, regardless of where their resources are located.
-
10
Kafka-Pixy
gRPC/REST proxy for Kafka
Kafka-Pixy is a dual API (gRPC and REST) proxy for Kafka with automatic consumer group control. It is designed to hide the complexity of the Kafka client protocol and provide a stupid simple API that is trivial to implement in any language. Kafka-Pixy is tested against Kafka versions 1.1.1 and 2.3.0, but is likely to work with any version starting from 0.8.2.2. It uses the Kafka Offset Commit/Fetch API to keep track of consumer offsets. However Group Membership API is not yet implemented... -
11
armor
Uncomplicated, modern HTTP server
Uncomplicated, modern HTTP server. Serve HTTP/2. Automatically install TLS certificates from https://letsencrypt.org. Proxy HTTP and WebSocket requests. Define virtual hosts with path level routing. Graceful shutdown. Limit request body. Serve static files. Log requests. Gzip response. Cross-origin Resource Sharing (CORS). Security, XSSProtection. ContentTypeNosniff. ContentSecurityPolicy. HTTP Strict Transport Security (HSTS). Add/Remove trailing slash from the URL with the option to redirect. -
12
Modlishka
Powerful and flexible HTTP reverse proxy
Modlishka is a powerful and flexible HTTP reverse proxy. It implements an entirely new and interesting approach of handling browser-based HTTP traffic flow, which allows to transparently proxy of multi-domain destination traffic, both TLS and non-TLS, over a single domain, without the requirement of installing any additional certificate on the client. What exactly does this mean? In short, it simply has a lot of potential, that can be used in many use case scenarios. Modlishka was written... -
13
Manba
HTTP API Gateway
Manba is a restful API gateway based on HTTP, which can be used as a unified API access layer. Please make sure your Go version is 1.10 or above. Otherwise, undefined "math/rand". Shuffle error will occur when compiling. Traffic Control (on Server or API). Circuit Breaker (on Server or API). Load balance, service discovery, plugin. Routing (Divert Traffic, Duplicate Traffic). API Aggregation. API Argument Check, API Access Control (White and Black List), API Default Return Value, API... -
14
Gzip Handler
Go middleware to gzip HTTP responses
This is a tiny Go package that wraps HTTP handlers to transparently gzip the response body, for clients which support it. Although it's usually simpler to leave that to a reverse proxy (like nginx or Varnish), this package is useful when that's undesirable. Call GzipHandler with any handler (an object which implements the http.Handler interface), and it'll return a new handler which gzips the response. -
15
WSDL to Go
WSDL2Go code generation as well as its SOAP proxy
Generates Go code from a WSDL file. Generate idiomatic Go code as much as possible. Support only Document/Literal wrapped services, which are WS-I compliant. Supports XML, Schema 1.0, SOAP 1.1. Resolve external XML Schemas. Support external and local WSDL. -
16
Firefly
A proxy software to help circumventing the Great Firewall
Firefly is an agent used to access Great Firewall (GFW) blocked websites and applications. Under the default settings, Firefly only goes through VPN forwarding wall of IP traffic, IP wall straight. If you find a website or application you cannot access, Firefly flow mechanism can be built to distinguish between an error. In this case, you can choose to forward all traffic through the VPN, and then try again. -
17
Codis
Proxy based Redis cluster solution supporting pipeline
Codis is a proxy-based high-performance Redis cluster solution written in Go. It is production-ready and widely used at wandoujia.com and many companies. You can see Codis Releases for latest and most stable releases. GUI website dashboard & admin tools. Supports most of Redis commands. Fully compatible with Twemproxy. Proxies can register on zk/etcd, clients can avoid dead proxies, see "High Availability" section. "Resharding" means migrating the data in one slot from one redis server... -
18
Go HTTP tunnel
Fast and secure tunnels over HTTP/2
Go HTTP tunnel is a reverse tunnel based on HTTP/2. It enables you to share your local host when you don't have a public IP. The tunnel client tunnel requires a configuration file, by default it will try reading tunnel.yml in your current working directory. If you want to specify other file use -config flag. A client opens TLS connection to a server. The server accepts connections from known clients only. The client is recognized by its TLS certificate ID. The server is publicly available... -
19
COW
HTTP proxy to automatically identify blocked sites
HTTP proxy written in Go. COW can automatically identify blocked sites and use parent proxies to access. COW's design goal is automation. Ideally, users don't need to care about which websites are inaccessible, and they can directly connect to the website without slowing down the access speed due to the use of secondary agents. As an HTTP proxy, it can be provided to mobile devices; if deployed on a domestic server, it can be used as an APN proxy. Support HTTP, SOCKS5, shadowsocks and cow... -
20
Switcher
Run SSH and HTTP(S) on the same port
Switcher is a proxy server that accepts connections and proxies based on which protocol is detected. Switcher is heavily influenced by sslh. It started out as a learning exercise to discover how sslh worked and attempt an implementation in Go. The result is useful in its own right through use of Go's interfaces for protocol matching (making adding new protocols trivial), and lightweight goroutines (instead of forking, which is more CPU intensive under load). -
21
Nagios Proxy
Proxies the Nagios command fifo.
Nagios Proxy is a client server system intended to be used in a secure environment. The client will appear to external software as a Nagios service. It accepts any data on the Nagios command fifo and forwards it to the server. When HUPped it collects the config files and forward those to the server. The server will pass commands and config files on to the real Nagios process. -
22
dataflowkit
Golang framework for scraping data from web pages
Golang Web Scraper library for extracting data from web pages. Save results as CSV, JSON, XML