Search Results for "linux proxy scraper" - Page 10
Sort By:
Showing 726 open source projects for "linux proxy scraper"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
1
proxysocket
Portable C library for proxy client support using standard SOCKETs.
Cross-platform C library to establish TCP connections using a proxy. Supports different connection methods: - no proxy (optionally allowing to bind to a local address and/or port) - HTTP proxy: only CONNECT method, only without authentication or basic authentication - SOCKS4: without IDENT functionality - SOCKS5 (RFC 1928): only without authentication or username/password Features: - Currently only support IPv4 TCP connections. - Returns a standard operating system SOCKET that... -
2
BiliLite
Bilibili UWP Lite
BiliLite is an archived third-party Bilibili client created for Microsoft's Universal Windows Platform. It provides a native Windows interface for browsing and consuming Bilibili content outside the official web experience. The application includes pages for videos, anime seasons, live content, rankings, regions, tags, search, and user information. A dedicated player handles media playback, while local playback and download pages support additional viewing workflows. Its codebase also... -
3
Martian Proxy
Martian is a library for building custom HTTP/S proxies
Martian Proxy is a programmable HTTP proxy designed to be used for testing. Martian is a great tool to use if you want to verify that all (or some subset) of requests are secure. Mock external services at the network layer. Inject headers, modify cookies or perform other mutations of HTTP requests and responses. Verify that pingbacks happen when you think they should. Unwrap encrypted traffic (requires install of CA certificate in browser) By taking advantage of Go cross-compilation, Martian... -
4
TP-LINK WR740/741N 16M FLASH
TP-Link WR740/741 version 4.xx, upgraded with 16MB spi flash OpenWRT
TP-Link WR740/741 version 4.xx, upgraded with 16MB (original is 4MB) spi flash and make and install OpenWRT version 22.03.3 and other software (Squid proxy, htop, Midnight commander, Dual WAN support, Load balancer, AdGuard, Wireless Shedule, OpenVPN Client and others. Original source: https://openwrt.org -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
Clashy
A GUI proxy client for Windows / Mac / Ubuntu Desktop based on Clash
A GUI proxy client for Windows / Mac / Ubuntu Desktop based on Clash and Electron. Windows / Mac / Ubuntu. -
6
AutoScraper
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
This project is made for automatic web scraping to make scraping easy. It gets a URL or the HTML content of a web page and a list of sample data that we want to scrape from that page. This data can be text, URL or any HTML tag value of that page. It learns the scraping rules and returns similar elements. Then you can use this learned object with new URLs to get similar content or the exact same element of those new pages. -
7
Fuso
Lightweight intranet penetration, port forwarding tool
Fuso is a lightweight intranet penetration and port-forwarding tool written in Rust. It is designed to expose internal services through a relay-style setup while remaining small, fast, and efficient. The project supports multiple connections, cascading proxy behavior, transmission encryption, and both TCP and UDP forwarding workflows. It can also work with SOCKS5 scenarios, including UDP forwarding in newer releases. Fuso is useful for developers and system administrators who need controlled... -
8
generator-ngx-rocket
Extensible Angular 13+ enterprise-grade project generator
Extensible Angular 5+ enterprise-grade project generator based on angular-cli with best practices from the community. Bootstrap, Angular Material or even Ionic are available, just pick one and start to code. Save time and maintenance effort by creating Progressive Web App and mobile app with the same code base. The app template is based on HTML5, TypeScript and Sass. Optimized build and bundling process with Webpack. Development server with backend proxy and live reload. Cross-browser CSS... -
9
Dispatch-Proxy
Combine internet connections, increase your download speed
dispatch-proxy is a Node.js tool that exposes a local proxy and distributes outgoing connections across multiple network interfaces to combine bandwidth for parallel transfers. Instead of trying to accelerate a single TCP flow, it improves aggregate throughput by load-balancing many connections—useful for download managers, package managers, or browsers that open multiple requests at once. It can bind new outbound sockets to different interfaces, letting a machine take advantage of Wi-Fi and... -
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
10
sproxy
Reverse proxy
sproxy is a reverse proxy that acts as a proxy server in the edge section close to the user on behalf of various web servers. Github: https://github.com/SolboxOSS/sproxy Project page: https://sproxy.solbox.com/ -
11
mlscraper
ML-based HTML scraper that learns extraction rules from examples
mlscraper is a Python library designed to automatically extract structured data from HTML pages without requiring developers to manually write CSS selectors or XPath rules. Instead of defining extraction logic by hand, users provide a few examples of the data they want to retrieve from a webpage. It analyzes those examples within the HTML document and determines patterns or rules that can be used to extract the same type of information from similar pages. Once trained, the generated scraper... -
12
A client implementation of Secure Socket Tunneling Protocol (SSTP) for Linux / Mac OS-X that allows remote access via SSTP VPN to Microsoft Windows 2008 Server. This project has been moved to https://gitlab.com/eivnaes/sstp-client
-
13
Browser Pool
A Node.js library to easily manage and rotate a pool of web browsers
Browser Pool is a small, but powerful and extensible library, that allows you to seamlessly control multiple headless browsers at the same time with only a little configuration, and a single function call. Currently it supports Puppeteer, Playwright and it can be easily extended with plugins. We created Browser Pool because we regularly needed to execute tasks concurrently in many headless browsers and their pages, but we did not want to worry about launching browsers, closing browsers,... -
14
SecretAgent
The web scraper that's nearly impossible to block
SecretAgent is a headless browser that’s nearly impossible to detect. It achieves this by emulating real users. And it has powerful auto-replay functionality that lets you create and debug scripts in record setting time. -
15
pspider
Simple Python framework for building multithreaded web crawlers
PSpider is a lightweight web crawling framework written in Python designed to simplify the development of custom web spiders. It focuses on providing an easy-to-understand architecture while still supporting concurrent crawling for improved performance. It uses a multithreaded model that separates the crawling workflow into several components responsible for fetching, parsing, and saving data. Tasks are managed through queues, allowing different parts of the crawler to process work... -
16
Scylla
Intelligent proxy pool for collecting and managing public proxies
Scylla is an open source proxy pool system designed to collect, validate, and manage large numbers of public proxy servers for use in web scraping and data extraction workflows. It automatically crawls the internet to discover proxy IP addresses and evaluates their availability and reliability before adding them to a usable pool. It includes a JSON API that allows developers and applications to retrieve proxy information programmatically, making it easier to integrate proxy rotation into... -
17
WebTTY
Share a terminal session over WebRTC
WebTTY is a terminal-sharing tool that lets a user share an interactive shell session over WebRTC. It is useful for pair programming, collaborative debugging, remote help, or accessing systems behind NAT without setting up a traditional proxy server. The project includes a command-line workflow and an in-browser client, so a session can be joined through a static web page when needed. It supports custom commands, allowing users to share a shell, a tmux session, or another terminal-based... -
18
Hetty
An HTTP toolkit for security research
Hetty is an HTTP toolkit for security research. It aims to become an open-source alternative to commercial software like Burp Suite Pro, with powerful features tailored to the needs of the infosec and bug bounty communities. Machine-in-the-middle (MITM) HTTP proxy, with logs and advanced search. HTTP client for manually creating/editing requests, and replay proxied requests. Intercept requests and responses for manual review (edit, send/receive, cancel) Scope support, to help keep work... -
19
V2Ray Desktop
Elegant cross-platform proxy GUI client that supports Shadowsocks
We use Clash as the backend proxy, which supports Shadowsocks(R), V2Ray, and Trojan protocols. V2Ray Desktop is a cross-platform GUI client that supports Shadowsocks(R), V2Ray, and Trojan protocols, running on Windows, Linux, and macOS. It is built with Qt 5 and QML 2. Compared to V2Ray, V2Ray Desktop provides more advanced features such as server subscription and latency test. -
20
Laravel Trusted Proxies
Laravel Proxy Package for handling sessions when behind load balancers
Setting a trusted proxy allows for correct URL generation, redirecting, session handling and logging in Laravel when behind a reverse proxy such as a load balancer or cache. Laravel 5.5+ comes with this package. If you are using Laravel 5.5 or greater, you do not need to add this to your project separately. Setting a trusted proxy allows for correct URL generation, redirecting, session handling and logging in Laravel when behind a reverse proxy. This is useful if your web servers sit behind... -
21
Till
DataHen Till is a companion tool to your existing web scraper
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes. Web scraping is usually easy to get started, especially on a small scale. However, as you try to scale it up, it gets exponentially difficult. Scraping 10,000 records can easily be done with simple web scraper scripts in any programming language, but as you try to scrape... -
22
Apache2::ModProxyPerlHtml
Reverse proxy with http header, html and javascript code rewritter
Apache2::ModProxyPerlHtml is the most advanced Apache output filter to rewrite HTTP headers and HTML links for reverse proxy usage. It is written in Perl and exceeds all mod_proxy_html.c limitations without performance lost. It is very simple and has far better parsing/replacement of URL than the original C code. It also support meta tag, CSS, and javascript URL rewriting and can be use with compressed HTTP. You can now replace any code by other, like changing images name or anything else.... -
23
jackpot-proxy
A SOCKS5-over-TLS Proxy
Jackpot-proxy is a SOCKS5-over-TLS proxy. Like what features of HTTPS has, jackpot-proxy can protect SOCKS5 stream under TLS layer. -
24
Sn3rpOs_v7.21: CoNt4g1N
TinFoilSec Presents: Sn3rpOs_v7.21 (CoNt4g1N)
*Updated 11/05/2021 TinfoilSec Presents: Sn3rpOs [Codename: CoNt4g1N] Features: Xfce4 Desktop Kali Linux Full System Torified with Privoxy & Tor bleachbit Wire Signal Veracrypt All repos transported through Privoxy&Tor dnscrypt-proxy (no-logs) Tor Browser Custom Tor Switcher and Pyloris Firefox-esr (configured with tor) Thunderbird ProtonVPN (Free VPN no-logs) Sn1per Vault Scanner RED_HAWK Fork of Kali Rolling, Debian Stretch/Buster -No Back Doors- Now with UEFI boot support and of course bacon. ... -
25
EM-WebSocket
EventMachine based WebSocket server
EM-WebSocket is an asynchronous WebSocket server library for Ruby built on the EventMachine networking framework. It lets applications accept connections and react to open, message, close, error, ping, and pong events through callbacks. The server supports the standardized WebSocket protocol as well as numerous older drafts retained for legacy compatibility. Connection handshakes expose paths, query strings, origins, headers, protocol versions, and security status. The library can serve...
