Search Results for "linux proxy scraper" - Page 12
Sort By:
Showing 726 open source projects for "linux proxy scraper"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Earn up to 16% annual interest with Nexo.Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.
-
1
Streisand
Streisand sets up a new server running your choice
Streisand is a tool that automates the deployment of censorship-resistant VPN services on cloud servers. It was created to help users bypass internet censorship and surveillance by quickly setting up secure communication channels without needing deep system administration expertise. With just a cloud provider account and basic Unix command-line knowledge, Streisand can provision a server and configure multiple VPN and proxy protocols almost automatically. This includes OpenVPN, WireGuard,... -
2
Smart Cache is a fast pure Java HTTP proxy server with offline browsing support. It has URL blocking, URL rewriting. Cached files has not headers inside and cache directory structure copies closely remote server. Supports also large caches.
-
3
Smart Cache Loader
Very configurable web downloader
Smart Cache Loader is a very configurable pure Java web grabber with special support for integration with Smart Cache proxy server. It can perform different loading operations based on URL mask, content-type, ... -
4
AWGG
AWGG Advanced WGet GUI
AWGG comes from Advanced Wget GUI. AWGG is a lightweight multiplatform and multilanguage download manager, basically a wget frontend and other tools like aria2, curl, youtube-dl and axel. AWGG is written in Free Pascal , using CodeTyphon and Lazarus IDE. -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
5
DNS2SOCKS
DNS to SOCKS or HTTP proxy
This is a command line utility to resolve DNS requests via a SOCKS tunnel like Tor or a HTTP proxy. -
6
v2rayL
v2ray linux GUI
V2Ray is a tool under Project V. Project V includes a series of tools to help you create your own customized network system. And V2Ray belongs to the core one. Simply put, V2Ray is a proxy software similar to Shadowsocks, but has more advantages than Shadowsocks.v2ray linux client, using pyqt5 to write GUI interface, the core is based on v2ray-core (v2ray-linux-64) vmess supports websocket, mKcp, and tcp. There may be some bugs in the current program, but they have not been tested. If you find bugs during use, please submit them in issue for improvement. ... -
7
HTTP Proxy Injector
Custom HTTP Proxy Header Injection Application
HTTP Proxy Injector Custom HTTP Proxy Header Injection Application HTTP Proxy Injector is a simple but powerful tool to modify http proxy header requests and respons, to use with SSH or VPN on Windows OS. Access blocked websites behind firewall and many other functions. Free to use for everyone. Want to help HTTP Proxy Injector keep in existence and get better ? Please visit and share our Patreon, Google Sites or Facebook Page :) You can help HTTP Proxy Injector on or using... -
8
armor
Uncomplicated, modern HTTP server
Uncomplicated, modern HTTP server. Serve HTTP/2. Automatically install TLS certificates from https://letsencrypt.org. Proxy HTTP and WebSocket requests. Define virtual hosts with path level routing. Graceful shutdown. Limit request body. Serve static files. Log requests. Gzip response. Cross-origin Resource Sharing (CORS). Security, XSSProtection. ContentTypeNosniff. ContentSecurityPolicy. HTTP Strict Transport Security (HSTS). Add/Remove trailing slash from the URL with the option to redirect. -
9
Kafka-Pixy
gRPC/REST proxy for Kafka
Kafka-Pixy is a dual API (gRPC and REST) proxy for Kafka with automatic consumer group control. It is designed to hide the complexity of the Kafka client protocol and provide a stupid simple API that is trivial to implement in any language. Kafka-Pixy is tested against Kafka versions 1.1.1 and 2.3.0, but is likely to work with any version starting from 0.8.2.2. It uses the Kafka Offset Commit/Fetch API to keep track of consumer offsets. However Group Membership API is not yet implemented,... -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
10
Venom
A Multi-hop Proxy for Penetration Testers
Venom is a Go-based multi-hop proxy tool designed for authorized penetration testing, red-team labs, and security education. It helps operators connect multiple nodes and use them as stepping stones for routing traffic across segmented internal networks. The project uses an admin-and-agent architecture, allowing the controller to manage connected nodes and build proxy chains. Venom is useful for studying pivoting, internal routing, SOCKS proxying, and controlled traffic relay in lab or... -
11
X-RAY
The next web scraper, see through the <html> noise
Supports strings, arrays, arrays of objects, and nested object structures. The schema is not tied to the structure of the page you're scraping, allowing you to pull the data in the structure of your choosing. The API is entirely composable, giving you great flexibility in how you scrape each page. Paginate through websites, scraping each page. X-ray also supports a request delay and a pagination limit. Scraped pages can be streamed to a file, so if there's an error on one page, you won't... -
12
HTTP adapter
A lightweight and extensible HTTP adapter, editable HTTP server
A lightweight and extensible HTTP adapter, editable HTTP server, Webhook transformation, and request relay platform. Just route, filter, validate, transform, relay and response to your HTTP requests. Setup your HTTP server in 3 minutes with a few YAML configurations and a few TS/JS code snippets. -
13
django-dynamic-scraper
Creating Scrapy scrapers via the Django admin interface
Django Dynamic Scraper (DDS) is an app for Django build on top of the scraping framework Scrapy. While preserving many of the features of Scrapy it lets you dynamically create and manage spiders via the Django admin interface. With Django Dynamic Scraper (DDS) you can define your Scrapy scrapers dynamically via the Django admin interface and save your scraped items in the database you defined for your Django project. Since it simplifies things DDS is not usable for all kinds of scrapers, but... -
14
PivotSuite
Network Pivoting Toolkit
PivotSuite is a portable, platform-independent and powerful network pivoting toolkit, Which helps Red Teamers / Penetration Testers to use a compromised system to move around inside a network. It is a Standalone Utility, Which can use as a Server or as a Client. If the compromised host is directly accessible (Forward Connection) from Our pentest machine, Then we can run pivotsuite as a server on the compromised machine and access the different subnet hosts from our pentest machine, Which was... -
15
ProxyBroker
Asynchronous tool for finding and checking public proxy servers
ProxyBroker is an open source Python tool designed to automatically discover and verify public proxy servers from many online sources. It operates asynchronously, allowing it to gather and test large numbers of proxies efficiently while performing multiple checks concurrently. It collects proxy addresses from dozens of providers and evaluates whether they are functional and suitable for use. It supports several proxy protocols, including HTTP, HTTPS, SOCKS4, and SOCKS5, making it flexible... -
16
Kitsunebi
A fully-featured V2Ray client for Android
A fully-featured V2Ray client for Android. The Core used by Kitsunebi extends the function of v2ray-core, and adds a strategy of selecting the fastest node according to the node delay value. You can add a node group on the graphical interface to enable it. If you use custom configuration, there are several configuration items, except for tolerance. The delay test is not ICMP Ping or TCP Ping, the method used is roughly the same as that used by the latency strategy in load balancing, actually... -
17
WebExtractServer
WebExtractServer use with WebExtractLte for use with web browsers
Browse data, fetched by WebExtractLte directly in your browser. Designed to be used with Webscraper (webscraper.io) - third party web scraper tool, available as plugin for Chrome and Firefox. -
18
Gzip Handler
Go middleware to gzip HTTP responses
This is a tiny Go package that wraps HTTP handlers to transparently gzip the response body, for clients which support it. Although it's usually simpler to leave that to a reverse proxy (like nginx or Varnish), this package is useful when that's undesirable. Call GzipHandler with any handler (an object which implements the http.Handler interface), and it'll return a new handler which gzips the response. -
19
Jupyter Server Proxy
Jupyter notebook server extension to proxy web services.
Jupyter Server Proxy lets you run arbitrary external processes (such as RStudio, Shiny Server, Syncthing, PostgreSQL, Code Server, etc) alongside your notebook server and provide authenticated web access to them using a path like /rstudio next to others like /lab. Alongside the Python package that provides the main functionality, the JupyterLab extension (@jupyterhub/jupyter-server-proxy) provides buttons in the JupyterLab launcher window to get to RStudio for example. -
20
Whonix
Whonix is an Anonymous Operating System.
THIS IS NOT WHONIX'S HOMEPAGE. Please go to: https://www.whonix.org/ (This is only Whonix's sourceforge must-have project page.) Whonix is an operating system focused on anonymity, privacy and security. It's based on the Tor anonymity network, Debian GNU/Linux and security by isolation. DNS leaks are impossible, and not even malware with root privileges can find out the user's real IP. Whonix consists of two parts: One solely runs Tor and acts as a gateway, which we call... -
21
Scrupless
The code behind www.scrupless.net
The reverse proxy sitting behind http://www.scrupless.net doing dynamic rewrites of arbitrary live sites. -
22
bullet-proxy
Bullet proxy: A free proxy
1.A free http Proxy . 2. Open http://144.34.227.196:8281/home and sign in ， you will got 10GB/Month for free; 3. For window user ，the local proxy server IP Address is 127.0.0.1, Port is 10000. you can set the proxy by yourself according to this article https://www.howtogeek.com/tips/how-to-set-your-proxy-settings-in-windows-8.1/ -
23
ScrapeEver
Proxy scraper
Automatic proxies scraper -
24
Firefly
A proxy software to help circumventing the Great Firewall
Firefly is an agent used to access Great Firewall (GFW) blocked websites and applications. Under the default settings, Firefly only goes through VPN forwarding wall of IP traffic, IP wall straight. If you find a website or application you cannot access, Firefly flow mechanism can be built to distinguish between an error. In this case, you can choose to forward all traffic through the VPN, and then try again. -
25
GSnova
Private proxy solution & network troubleshooting tool
GSnova is a high-performance proxy tool for bypassing internet censorship and securing network traffic through a range of supported transport protocols. It acts as a multi-protocol client/server proxy that can tunnel traffic over TLS, WebSocket, KCP, QUIC, and SSH. GSnova is optimized for resilience and speed under restrictive network conditions and supports multiple fronting strategies and obfuscation techniques. It's particularly suited for users in highly censored environments and...
