Search Results for "linux proxy scraper" - Page 9
Sort By:
Showing 712 open source projects for "linux proxy scraper"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Compliant and Reliable File Transfers Backed by Top Security CertificationsStop relying on non-certified, legacy file transfer tools that creak under the weight of modern security demands. Get full audit trails, advanced access controls and more supported by an award-winning team of experts. Start your free 25-day trial today.
-
1
rathole
A lightweight and high-performance reverse proxy for NAT traversal
A secure, stable and high-performance reverse proxy for NAT traversal, written in Rust. rathole, like frp and ngrok, can help to expose the service on the device behind the NAT to the Internet, via a server with a public IP. High Performance Much higher throughput can be achieved than frp, and more stable when handling a large volume of connections. Low Resource Consumption Consumes much fewer memory than similar tools. See Benchmark. The binary can be as small as ~500KiB to fit the... -
2
Tengine
A distribution of Nginx with some advanced features
Tengine is a web server originated by Taobao, the largest e-commerce website in Asia. It is based on the Nginx HTTP server and has many advanced features. Tengine has proven to be very stable and efficient on some of the top 100 websites in the world, including taobao.com and tmall.com. Tengine has been an open source project since December 2011. It is being actively developed by the Tengine team, whose core members are from Taobao, Sogou and other Internet companies. Tengine is a community... -
3
ddgr
DuckDuckGo from the terminal
ddgr is a cmdline utility to search DuckDuckGo from the terminal. While googler is highly popular among cmdline users, in many forums the need of a similar utility for privacy-aware DuckDuckGo came up. DuckDuckGo Bangs are super-cool too! So here's ddgr for you! Unlike the web interface, you can specify the number of search results you would like to see per page. It's more convenient than skimming through 30-odd search results per page. The default interface is carefully designed to use... -
4
ShadowsocksR, V2Ray Client Android
A simple client for Android
A fully featured ShadowsocksR, V2Ray and Trojan client for Android, written in Scala. If you use x64 linux like Archlinux x86_64, or your Linux has new version ncurses lib, you may need install the 32bit version ncurses and link it as follow (make sure all these *.so files in the right location under your system, otherwise you have to copy them to /usr/lib/ and /usr/lib32/ directory). -
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
5
FancySS
fancyss is a project for bypassing the Great Firewall (GFW)
Fancyss is a “scientific Internet access / bypassing censorship” toolkit targeted principally to Asus routers running AsusWRT or Merlin-based firmware. The project provides a plugin suite (with “software center” integration) so that home routers can run proxy or tunneling tools (e.g. V2Ray) to circumvent firewall or censorship (“GFW” in the Chinese context). Because it integrates into the router’s firmware environment, fancyss automates configuration, routing, and firewall rules to minimize... -
6
Artica Proxy Appliance
Proxy Cache and Web filtering Appliance
Artica Proxy is a system that provide a sexy Web Ajax console in order manage a full Proxy server without any technical skill and with latest Squid technology. It provide surls filtering with french Toulouse University and Artica database - over 30.000.000 websites. There are many statistics per users or categories or websites and features in order to manage Internet bandwith. It provides FireWall/QOS features. Can work in Transparent mode or connected to an Activ Directory/OpenLDAP... -
7
WARP one-click script
Add an IPv4, IPv6 or dual-stack CloudFlare WARP network interface
WARP one-click script. Add an IPv4, IPv6 or dual-stack Cloudflare WARP network interface and Socks5 proxy for VPS. First publication on a global scale. By WireProxy, Wireguard client that exposes itself as a socks5 proxy. First release on the whole network, through wireproxy, let WARP suggest a socks5 proxy locally. Support WARP on Debian9; 1.Support WARP on Debian 9. Support WARP+ account, with third-party brush WARP+ traffic and upgrade kernel BBR script. -
8
ShadowsocksR-native
ShadowsocksR (SSRoT) native implementation for all platforms
ShadowsocksR-native is a lightweight secured SOCKS5 proxy for embedded devices and low-end boxes. It's derived from Shadowsocks-libev. -
9
Tholian Stealth
Secure, Peer-to-Peer, Private and Automateable Web Browser
Tholian Stealth is an open-source privacy-focused web browser and automation platform designed to combine secure browsing, web scraping, and proxy functionality into a unified system. It aims to prioritize user privacy and autonomy by minimizing tracking, blocking unnecessary requests, and restricting potentially harmful web technologies such as JavaScript execution. The platform operates as both a browser and a network service, capable of acting as a proxy, scraper, and content filtering system for other applications. ... -
Stop Cyber Threats with VM-Series Next-Gen Firewall on AzureGain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
-
10
SCFProxy
A proxy tool based on cloud function
SCFProxy is a tool to implement HTTP proxy, SOCKS proxy, and reverse proxy based on cloud function and API gateway provided by several cloud service providers. -
11
haoel.github.io
Comprehensive guide on self-hosting proxies, VPNs and transparent gate
This repository is a hands-on, longform guide for building and operating your own “scientific” Internet access setup — i.e., self-hosted proxies, VPNs, and transparent gateways — so you can reach blocked resources, protect privacy, and learn the underlying networking principles. It walks through buying and evaluating VPSes (regions, bandwidth, CN2/GIA lines), enabling kernel/network optimizations (BBR), and applying production practices like TLS certificates with Let’s Encrypt and using... -
12
Outline Client
Outline clients, developed by Jigsaw
Outline clients, developed by Jigsaw. The Outline clients use the popular Shadowsocks protocol, and lean on the Cordova and Electron frameworks to support Windows, Android / ChromeOS, Linux, iOS and macOS. The Outline Client is a cross-platform VPN or proxy client for Windows, macOS, iOS, Android, and ChromeOS. The Outline Client is designed for use with the Outline Server software, but it is fully compatible with any Shadowsocks server. The client's user interface is implemented in Polymer 2.0. Platform support is provided by Cordova and Electron, with additional native components in this repository. ... -
13
Goutte
Goutte, a simple PHP Web Scraper
Goutte is a screen scraping and web crawling library for PHP. Goutte provides a nice API to crawl websites and extract data from the HTML/XML responses. Goutte depends on PHP 7.1+. Add fabpot/goutte as a require dependency in your composer.json file. Create a Goutte Client instance (which extends Symfony\Component\BrowserKit\HttpBrowser). Make requests with the request() method. The method returns a Crawler object (Symfony\Component\DomCrawler\Crawler). To use your own HTTP settings, you may... -
14
Outline Apps
Outline Client and Manager, developed by Jigsaw
Codecov currently only tracks the /client Apple libraries and core web view code. Outline makes it easy for anyone to create a VPN server, allowing you to share access to the free and open internet with those in need. A cross-platform proxy client for Windows, macOS, iOS, Android, and Linux. The Outline Client is designed for use with the server deployed with the Outline Manager, but it is also fully compatible with any Shadowsocks server. -
15
Nginx-Clojure
Nginx module for embedding Clojure or Java or Groovy programs
Nginx module for embedding Clojure or Java or Groovy programs, typically those Ring based handlers. Compatible with Ring and obviously supports those Ring-based frameworks, such as Compojure, etc. HTTP Services by using Clojure / Java / Groovy to write simple handlers for HTTP services. A build-in Jersey container to support java standard RESTful web services (JAX-RS 2.0). Tomcat 8 embedding support (so servlet 3.1/jsp/sendfile/JSR-356 WebSocket work within nginx!). Dynamic proxying by using... -
16
Privaxy
Privaxy is the next generation tracker and advertisement blocker
Next generation tracker and advertisement blocker. Privaxy is a MITM HTTP(s) proxy that sits in between HTTP(s) talking applications, such as a web browser and HTTP servers, such as those serving websites. By establishing a two-way tunnel between both ends, Privaxy is able to block network requests based on URL patterns and to inject scripts as well as styles into HTML documents. Operating at a lower level, Privaxy is both more efficient as well as more streamlined than browser add-on-based... -
17
proxysocket
Portable C library for proxy client support using standard SOCKETs.
Cross-platform C library to establish TCP connections using a proxy. Supports different connection methods: - no proxy (optionally allowing to bind to a local address and/or port) - HTTP proxy: only CONNECT method, only without authentication or basic authentication - SOCKS4: without IDENT functionality - SOCKS5 (RFC 1928): only without authentication or username/password Features: - Currently only support IPv4 TCP connections. - Returns a standard operating system SOCKET that... -
18
Martian Proxy
Martian is a library for building custom HTTP/S proxies
Martian Proxy is a programmable HTTP proxy designed to be used for testing. Martian is a great tool to use if you want to verify that all (or some subset) of requests are secure. Mock external services at the network layer. Inject headers, modify cookies or perform other mutations of HTTP requests and responses. Verify that pingbacks happen when you think they should. Unwrap encrypted traffic (requires install of CA certificate in browser) By taking advantage of Go cross-compilation, Martian... -
19
TP-LINK WR740/741N 16M FLASH
TP-Link WR740/741 version 4.xx, upgraded with 16MB spi flash OpenWRT
TP-Link WR740/741 version 4.xx, upgraded with 16MB (original is 4MB) spi flash and make and install OpenWRT version 22.03.3 and other software (Squid proxy, htop, Midnight commander, Dual WAN support, Load balancer, AdGuard, Wireless Shedule, OpenVPN Client and others. Original source: https://openwrt.org -
20
Clashy
A GUI proxy client for Windows / Mac / Ubuntu Desktop based on Clash
A GUI proxy client for Windows / Mac / Ubuntu Desktop based on Clash and Electron. Windows / Mac / Ubuntu. -
21
AutoScraper
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
This project is made for automatic web scraping to make scraping easy. It gets a URL or the HTML content of a web page and a list of sample data that we want to scrape from that page. This data can be text, URL or any HTML tag value of that page. It learns the scraping rules and returns similar elements. Then you can use this learned object with new URLs to get similar content or the exact same element of those new pages. -
22
Fuso
Lightweight intranet penetration, port forwarding tool
Fuso is a lightweight intranet penetration and port-forwarding tool written in Rust. It is designed to expose internal services through a relay-style setup while remaining small, fast, and efficient. The project supports multiple connections, cascading proxy behavior, transmission encryption, and both TCP and UDP forwarding workflows. It can also work with SOCKS5 scenarios, including UDP forwarding in newer releases. Fuso is useful for developers and system administrators who need controlled... -
23
generator-ngx-rocket
Extensible Angular 13+ enterprise-grade project generator
Extensible Angular 5+ enterprise-grade project generator based on angular-cli with best practices from the community. Bootstrap, Angular Material or even Ionic are available, just pick one and start to code. Save time and maintenance effort by creating Progressive Web App and mobile app with the same code base. The app template is based on HTML5, TypeScript and Sass. Optimized build and bundling process with Webpack. Development server with backend proxy and live reload. Cross-browser CSS... -
24
Dispatch-Proxy
Combine internet connections, increase your download speed
dispatch-proxy is a Node.js tool that exposes a local proxy and distributes outgoing connections across multiple network interfaces to combine bandwidth for parallel transfers. Instead of trying to accelerate a single TCP flow, it improves aggregate throughput by load-balancing many connections—useful for download managers, package managers, or browsers that open multiple requests at once. It can bind new outbound sockets to different interfaces, letting a machine take advantage of Wi-Fi and... -
25
mlscraper
ML-based HTML scraper that learns extraction rules from examples
mlscraper is a Python library designed to automatically extract structured data from HTML pages without requiring developers to manually write CSS selectors or XPath rules. Instead of defining extraction logic by hand, users provide a few examples of the data they want to retrieve from a webpage. It analyzes those examples within the HTML document and determines patterns or rules that can be used to extract the same type of information from similar pages. Once trained, the generated scraper...
