Search Results for "linux proxy scraper"
Sort By:
Showing 61 open source projects for "linux proxy scraper"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
1
Proxy
Proxy: Next Generation Polymorphism in C++
For decades, object-based virtual tables have been a de facto implementation of runtime polymorphism in many (compiled) programming languages. There are many drawbacks in this mechanism, including life management (because each object may have a different size and ownership) and reflection (because it is hard to balance between usability and memory allocation). To workaround these drawbacks, some languages like Java or C# choose to sacrifice performance by introducing GC to facilitate... -
2
clash-rules
Clash Premium rule set (RULE-SET), compatible with ClashX Pro
clash-rules is a repository that provides rule sets and configuration files designed for proxy tools and systems like V2Ray / Clash — helping users to decide routing, blocking, or proxy behavior based on domain, IP, or other criteria. The repo aggregates many community-maintained lists: blocked domains, direct access lists, proxy-needed domains, geo-IP lists, and more — offering up-to-date and curated configuration data that reflects network conditions, censorship lists, or desirable routing... -
3
v2ray-rules-dat
V2Ray routing rules file enhanced version, which can replace V2Ray
v2ray-rules-dat is a repository that compiles and distributes enhanced rule data (domain lists, geo-IP/geo-domain data, block/proxy/detect lists) intended for use with tools like V2Ray, Xray-core, and similar network/proxy frameworks. The dataset serves as an alternative or supplement to official geoip/ geosite data files, often providing more up-to-date, community-curated entries — enabling better routing, blocking, or traffic management when using those proxy tools. The repository is... -
4
Node.js HTTP Proxy Agents Monorepo
Node.js HTTP Proxy Agents Monorepo
Proxy Agents is a Node.js monorepo containing HTTP agent implementations for routing requests through proxy servers. Its high-level proxy-agent package automatically selects the correct agent from standard environment variables such as HTTP_PROXY, HTTPS_PROXY, and NO_PROXY. Lower-level packages provide dedicated support for HTTP, HTTPS, SOCKS, and PAC-based proxy configurations. An LRU cache reuses compatible agent instances across requests to reduce repeated setup work. The repository also... -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
5
Cloudflare-Socks5
CF-workers/pages proxy script: supports Vless-ws (tls) and Trojan-ws
Cloudflare-Socks5 is a proxy deployment toolkit designed to leverage Cloudflare Workers and Pages to create flexible, censorship-resistant proxy nodes using protocols such as VLESS and Trojan. The project provides scripts that enable users to deploy proxy services locally without relying on external subscription providers, improving privacy and control over configuration data. It supports multiple transport modes including WebSocket with TLS, as well as optional encrypted handshake... -
6
ProxyAdmin
Proxy is a high-performance, full-function http proxy, https proxy
ProxyAdmin Free is a web-based management console for the goproxy networking and proxy server. It provides a graphical alternative to managing goproxy entirely through command-line arguments. Administrators can configure HTTP and HTTPS proxies, SOCKS5 services, internal network tunneling, and other supported proxy modes. The interface also exposes remote-access features such as VNC and Web-SSH alongside custom service configuration. -
7
warp-yg
Warp multi-function one-click script, supports warp-go and wgcf
warp-yg is a script-based toolkit designed to automate the deployment and optimization of Cloudflare WARP networking configurations for enhanced privacy and performance. It focuses on simplifying the integration of WireGuard-based WARP connections into proxy environments, allowing users to route traffic through optimized Cloudflare endpoints. The project includes functionality for selecting optimal endpoints and improving connection speed by dynamically identifying efficient routes. It is... -
8
CFnew
Cloudflare Workers-based proxy deployment project
CFnew is a Cloudflare Workers-based proxy deployment and subscription management project focused on generating optimized client configurations. It supports multiple proxy protocols and lets users manage paths, preferred IPs, and output formats through a more convenient interface. The project stores configuration through Cloudflare KV, which allows changes to take effect without redeploying the worker each time. It includes latency testing tools and automated format detection so different... -
9
x-ui-yg
The x-ui simplified and modified version of the script
x-ui-yg is a streamlined and modified version of the x-ui panel designed to simplify the management of Xray-based proxy services. It provides a web-based interface for configuring and monitoring multiple proxy protocols, allowing users to manage connections, users, and traffic from a centralized dashboard. The script supports a wide range of system architectures, including IPv4, IPv6, AMD64, and ARM64, making it versatile for deployment on different server types. It emphasizes local... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
sing-box-yg
Sing-box Hardcover Bucket 5-in-1 Agreement VPS Dedicated Script
sing-box-yg is a comprehensive automation script built around the sing-box core, designed to simplify the deployment and management of modern proxy protocols in a unified environment. It integrates multiple advanced networking technologies such as Hysteria2, TUIC, VLESS with Reality, and VMess configurations, enabling users to deploy diverse proxy solutions through a single streamlined workflow. The script supports multiple system environments including VPS, Docker, and containerized setups,... -
11
Surge-rules
The Surge rule set (DOMAIN-SET and RULE-SET) for the Surge for iOS
Surge-rules is a project devoted to maintaining and distributing rule sets compatible with the Surge proxy application (for macOS/iOS), intended for domain- or routing-based traffic management. Instead of manually building or maintaining Surge configuration files, users can rely on this repo to obtain up-to-date “RULE-SET” or “DOMAIN-SET” configurations that reflect community-curated lists of domains/IPs for direct access, proxying, blocking, or custom routing. Because network and domain... -
12
libhv
Network library for developing TCP/UDP/SSL/HTTP/WebSocket/MQTT client
Like libevent, libev, and libuv, libhv provides event loop with non-blocking IO and timer, but simpler api and richer protocols. Cross-platform (Linux, Windows, MacOS, BSD, Solaris, Android, iOS) High-performance EventLoop (IO, timer, idle, custom) TCP/UDP client/server/proxy. TCP supports heartbeat, reconnect, upstream, MultiThread-safe write and close, etc. Built-in common unpacking modes (FixedLength, Delimiter, LengthField) RUDP support: WITH_KCP. SSL/TLS support: (via WITH_OPENSSL or WITH_GNUTLS or WITH_MBEDTLS) HTTP client/server (support https http1/x http2 grpc). ... -
13
urllib3
Python HTTP library with thread-safe connection pooling
urllib3 is a powerful, user-friendly HTTP client for Python. Much of the Python ecosystem already uses urllib3 and you should too. Thread safety, connection pooling. Client-side TLS/SSL verification. File uploads with multipart encoding. Helpers for retrying requests and dealing with HTTP redirects. Support for gzip, deflate, brotli, and zstd encoding. Proxy support for HTTP and SOCKS. 100% test coverage. Professional support for urllib3 is available as part of the Tidelift Subscription.... -
14
3x-ui-Upgrade
Runs the Heimdall panel (an improved 3x-ui version of sh7CBAC)
3x-ui Upgrade is a deployment wrapper for running the Heimdall-enhanced 3x-ui panel on Railway through a single exposed port. It combines the management interface, subscription endpoint, and VLESS over WebSocket traffic behind an Nginx reverse proxy. The container downloads the latest Heimdall build during deployment and starts the required services automatically. SQLite is used by default, keeping the setup simple for modest user counts. Persistent Railway volumes can preserve panel users... -
15
edgetunnel
edgetunnel 2.0 VLESS/Trojan
edgetunnel is a modified version of a serverless tunnelling solution designed to run on platforms like Cloudflare Workers and Pages, enabling protocols such as VLESS and Trojan to be exposed through edge-functions rather than traditional servers. The project’s fork by cmliu emphasizes conversion of protocol configuration (especially VLESS) into subscription links, so that users can deploy and then generate “Clash” or “Sing-box” compatible subscription content easily. It provides a... -
16
BurpSuite for Pentester
This cheatsheet is built for the Bug Bounty Hunters
BurpSuite for Pentester is a structured learning repository for web application security testing with Burp Suite. It is designed for penetration testers, bug bounty researchers, and learners who want a practical reference for Burp's major capabilities. The collection explains how different tools fit into vulnerability discovery, request analysis, and testing workflows. Covered areas include Proxy, Repeater, Intruder, Scanner, Sequencer, Collaborator, and several popular extensions.... -
17
learn_python3_spider
Python crawler tutorial series, learning Python crawlers from 0 to 1
learn_python3_spider is a tutorial and example-code collection for learning web scraping with Python 3 from beginner to advanced topics. It introduces request capture, browser and mobile traffic inspection, and core scraping libraries such as Requests, BeautifulSoup, Selenium, Appium, and Scrapy. Lessons also cover JSON parsing, regular expressions, concurrency, proxy usage, login handling, and CAPTCHA-related techniques. Data can be stored with CSV, MySQL, or MongoDB examples. More advanced... -
18
workerpool
Offload tasks to a pool of workers on node.js and in the browser
workerpool is a JavaScript library that simplifies the creation and management of worker threads and process pools for parallel task execution in Node.js and browser environments. The project provides an abstraction layer that allows developers to offload CPU-intensive operations to background workers without manually handling thread communication or lifecycle management. It supports task queuing, dynamic worker scaling, timeouts, transferable objects, and proxy-based APIs for interacting... -
19
Hamcrest PHP
The PHP Hamcrest implementation
Hamcrest is a matching library originally written for Java, but subsequently ported to many other languages. hamcrest-php is the PHP port of Hamcrest and essentially follows a literal translation of the original Java API for Hamcrest, with a few Exceptions, mostly down to PHP language barriers. Unless it would be non-semantic for a matcher to do so, hamcrest-php allows dynamic typing for it's input, in "the PHP way". Exception are where semantics surrounding the type itself would suggest... -
20
AndroidLibXrayLite
Lightweight Android library that bundles the Xray networking core
AndroidLibXrayLite is a lightweight Android library that bundles the Xray networking core as an embeddable component for apps. Its purpose is to provide a minimal, size-optimized build of the native core with a clear Java/Kotlin interface to start, stop, and configure network tunnels. By exposing the core as an AAR with per-ABI artifacts, it keeps application footprints small while supporting common CPU architectures. The library abstracts process management and log streaming so host apps... -
21
DouyinLiveRecorder
Live recording software that can be looped and recorded
DouyinLiveRecorder is a Python and FFmpeg-based tool for continuously monitoring and recording live streams from many online platforms. Despite its name, it supports more than 40 services, including Douyin, TikTok, YouTube, Twitch, Bilibili, Huya, Douyu, Xiaohongshu, and several regional platforms. Users can place multiple room URLs in configuration files and let the program watch them repeatedly for live activity. Recording quality, output behavior, proxies, formats, and individual rooms... -
22
MobileHackersWeapons
Collection of cool tools used by Mobile hackers
MobileHackersWeapons is a curated collection of tools for Android and iOS security analysis, testing, and reverse engineering. The catalog groups projects by purpose rather than bundling them into a single executable toolkit. Categories include application analysis, penetration testing, proxies, reverse engineering, scanners, monitoring, device utilities, NFC, Bluetooth, jailbreak research, and certificate-unpinning tools. Listed projects span many languages and include both desktop... -
23
mimic
Intercept any app, then call it from Python like a library
Mimic is a Python tool that turns captured mobile application traffic into an editable client library. It records requests through mitmproxy, extracts stable authentication values, and uses an AI assistant to generate named Python methods for observed endpoints. Generated clients are ordinary source files built on mimic.App, so developers can inspect and modify them directly. The system can preserve request templates and model multi-step API flows in which one call supplies data for another.... -
24
WebHackersWeapons
A collection of cool tools used by Web hackers
WebHackersWeapons is a community-maintained catalog of tools used for web application security research and testing. Rather than providing one scanner, it indexes a broad ecosystem of specialized open-source security utilities. The collection spans analysis, penetration testing, proxies, scanners, reconnaissance, reverse engineering, fuzzing, automation, and supporting utilities. Individual entries link to their original projects so researchers can evaluate tools according to a particular... -
25
Anywhere
Running static file server anywhere
Anywhere is a Node.js command-line utility that turns any local directory into a static file server. Running the command without arguments serves the current folder on port 8000. Users can select another port, hostname, or document root through simple command-line options. The tool normally opens the default browser automatically, while silent mode starts the server without launching a window. An HTML5 history fallback can redirect client-side application routes to a selected index file....
