Search Results for "linux proxy scraper" - Page 22
Sort By:
Showing 1379 open source projects for "linux proxy scraper"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
hamsket
Free and Open Source messaging and emailing app that combines common w
Free, Open Source and Cross Platform messaging and emailing app that combines common web applications into one -
2
pspider
Simple Python framework for building multithreaded web crawlers
PSpider is a lightweight web crawling framework written in Python designed to simplify the development of custom web spiders. It focuses on providing an easy-to-understand architecture while still supporting concurrent crawling for improved performance. It uses a multithreaded model that separates the crawling workflow into several components responsible for fetching, parsing, and saving data. Tasks are managed through queues, allowing different parts of the crawler to process work... -
3
Mycat2
MySQL Proxy using Java NIO based on Sharding SQL, Calcite
Open source intermediate for the MySQL database network protocol written in Java language, open source of GPLv3 protocol. Custom Calcite distributed query engine, edit SQL to relationship algebra expression, rule optimization engine, and cost optimization engine, generate physical execution plan, support logic view. Any cross-currant cross-table join query, support cross-currant cross-table non-associated query, support cross-currant cross-table association query, support cross-currant... -
4
Proxy Manager
OOP Proxy wrappers/utilities to manage proxies of your objects
This library aims to provide abstraction for generating various kinds of proxy classes. Available as part of the Tidelift Subscription. The maintainer of ocramius/proxy-manager and thousands of other packages are working with Tidelift to deliver commercial support and maintenance for the open source dependencies you use to build your applications. Save time, reduce risk, and improve code health, while paying the maintainers of the exact dependencies you use. The suggested installation method... -
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
5
Scylla
Intelligent proxy pool for collecting and managing public proxies
Scylla is an open source proxy pool system designed to collect, validate, and manage large numbers of public proxy servers for use in web scraping and data extraction workflows. It automatically crawls the internet to discover proxy IP addresses and evaluates their availability and reliability before adding them to a usable pool. It includes a JSON API that allows developers and applications to retrieve proxy information programmatically, making it easier to integrate proxy rotation into... -
6
Alan Framework
A C2 post-exploitation framework
Alan Framework is a post-exploitation framework useful during red-team activities. You can run your preferred tool directly in-memory. JavaScript script execution (in-memory without third party dependency) Fully compliant SOCKS5 proxy. Supported agent types: Powershell (x86/x64), DLL (x86/x64), Executable (x86/x64), Shellcode (x86/x64). Server.exe can be executed in Linux (via dotnet core) The network communication is fully encrypted with a session key not recoverable from the agent binary or from a traffic dump. Communication performed via HTTP/HTTPS. No external dependencies or libraries need to be installed. ... -
7
WebTTY
Share a terminal session over WebRTC
WebTTY is a terminal-sharing tool that lets a user share an interactive shell session over WebRTC. It is useful for pair programming, collaborative debugging, remote help, or accessing systems behind NAT without setting up a traditional proxy server. The project includes a command-line workflow and an in-browser client, so a session can be joined through a static web page when needed. It supports custom commands, allowing users to share a shell, a tmux session, or another terminal-based... -
8
pacman.store
Pacman Mirror via IPFS for ArchLinux, Endeavouros, Manjaro
Under the domain pacman.store are package mirrors provided via the IPFS-Network. If you choose this as your mirror, Pacman will download the files from a local http-proxy and the accessed files will be shared with the IPFS-Network. If you run on multiple machines in your local network IPFS will exchange the files locally rather than downloading the same file multiple times from the internet. The data is held and shared by a collaborative cluster, which is provided by volunteers. Install ipfs... -
9
Hetty
An HTTP toolkit for security research
Hetty is an HTTP toolkit for security research. It aims to become an open-source alternative to commercial software like Burp Suite Pro, with powerful features tailored to the needs of the infosec and bug bounty communities. Machine-in-the-middle (MITM) HTTP proxy, with logs and advanced search. HTTP client for manually creating/editing requests, and replay proxied requests. Intercept requests and responses for manual review (edit, send/receive, cancel) Scope support, to help keep work... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
CheckinPanel
Automated check-in panel
checkinpanel is a self-hosted web panel that automates daily “check-in” tasks for various online services, turning tedious sign-ins and routine actions into scheduled jobs. It centralizes account credentials and cookies in one dashboard, then runs tasks on a cron-like schedule so they execute reliably without user intervention. The project emphasizes ease of deployment—commonly via Docker—and provides extensible task definitions so new sites can be added or customized. Notifications can be... -
11
V2RayCloudSpider
V2RayCloudSpider
V2RSS is an "ecological mining machine" that can perform vertical mining on global providers based on the SSPanel-Uim framework; it can generate bottom-up "aggregation collection" tasks for mainstream protocol headers; it can self-digest and Compared with proxypool , the output is purer and more reliable proxy nodes; it has powerful production features such as self-discovery and service self-healing. -
12
V2Ray Desktop
Elegant cross-platform proxy GUI client that supports Shadowsocks
We use Clash as the backend proxy, which supports Shadowsocks(R), V2Ray, and Trojan protocols. V2Ray Desktop is a cross-platform GUI client that supports Shadowsocks(R), V2Ray, and Trojan protocols, running on Windows, Linux, and macOS. It is built with Qt 5 and QML 2. Compared to V2Ray, V2Ray Desktop provides more advanced features such as server subscription and latency test. -
13
Ferdi
All your favorite services in one place
Ferdi is a desktop app that helps you get organized and work more efficiently by having all of your favorite apps in one application. Ferdi is based on Franz, a messaging browser that combines all messaging services into one application, but Ferdi offers a whole lot more. Ferdi puts all your web apps in one place, has "Find in Page" and "Quick Switch" features, makes all users Premium by default, and so much more! Ferdi supports multiple accounts on any service, has full proxy support and is... -
14
Leafnode is a caching Usenet news proxy that enables online newsreaders to read news off-line and aggregates news from various NNTP servers into one. It is designed for full-automatic maintenance, and IPv6 enabled.
-
15
icestark
Micro Frontends solution for large application
Use icestark to build your next micro-front application, or migrate your current giant application without pain. As simple as developing SPA applications, it not only solves the problem of synergy among multiple development teams, but also brings a safe sandbox and excellent performance experience. icestark uses the configuration of the micro-application entrance field to render the application, so this field very important. For different scenarios, icestark also supports a variety of... -
16
Laravel Trusted Proxies
Laravel Proxy Package for handling sessions when behind load balancers
Setting a trusted proxy allows for correct URL generation, redirecting, session handling and logging in Laravel when behind a reverse proxy such as a load balancer or cache. Laravel 5.5+ comes with this package. If you are using Laravel 5.5 or greater, you do not need to add this to your project separately. Setting a trusted proxy allows for correct URL generation, redirecting, session handling and logging in Laravel when behind a reverse proxy. This is useful if your web servers sit behind... -
17
Apache2::ModProxyPerlHtml
Reverse proxy with http header, html and javascript code rewritter
Apache2::ModProxyPerlHtml is the most advanced Apache output filter to rewrite HTTP headers and HTML links for reverse proxy usage. It is written in Perl and exceeds all mod_proxy_html.c limitations without performance lost. It is very simple and has far better parsing/replacement of URL than the original C code. It also support meta tag, CSS, and javascript URL rewriting and can be use with compressed HTTP. You can now replace any code by other, like changing images name or anything else.... -
18
Till
DataHen Till is a companion tool to your existing web scraper
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes. Web scraping is usually easy to get started, especially on a small scale. However, as you try to scale it up, it gets exponentially difficult. Scraping 10,000 records can easily be done with simple web scraper scripts in any programming language, but as you try to scrape... -
19
email2phonenumber
OSINT tool to discover phone numbers using an email address
email2phonenumber is an open source OSINT (Open Source Intelligence) tool designed to help researchers identify a target’s phone number using only an email address. The project was created as a proof-of-concept during research into new OSINT methodologies for extracting personal information from publicly accessible sources and account recovery mechanisms. The tool works by automating interactions with password reset processes on various online services, which may reveal masked phone number... -
20
Duktape
Embeddable Javascript engine with a focus on portability
Duktape is easy to integrate into a C/C++ project: add duktape.c, duktape.h, and duk_config.h to your build, and use the Duktape API to call ECMAScript functions from C code and vice versa. Partial support for ECMAScript 2015 (E6) and ECMAScript 2016 (E7), Post-ES5 feature status, kangax/compat-table. Combined reference counting and mark-and-sweep garbage collection with finalization. Property virtualization using a subset of ECMAScript ES2015 Proxy object. Bytecode dump/load for caching... -
21
html2canvas
A JavaScript HTML screenshot renderer
html2canvas is a JavaScript HTML renderer. The script provides you with the tools to take screenshots of webpages directly on the browser. The screenshot is based on the DOM and therefore, it may not be 100% accurate to the real representation, given that it is not an actual screenshot, but a type of screenshot built based on the available data and information of the page. The script renders such page as a canvas image, by reading the DOM and the different styles of the featured elements. It... -
22
DECK
DECK is a powerful and high performant local web development studio
DECK is a powerful and high-performing local web development studio unlike any other, install & try out more than 40+ open source stacks. Create any number of development environments right from your localhost. DECK's integrated marketplace lets you spin up stacks with just a click of a button. Popular web technologies such as LAMP, LEMP, MERN, MEAN, Laravel, Symfony, WordPress, Magento & many more are available out of the box. DECK's inbuilt SSL engine powered by LetsEncrypt and a... -
23
scraper-helper
A HTTP proxy that logs everything flowing through it
...All available documentation can be read online at http://scraper-helper.sourceforge.net/ -
24
Sn3rpOs_v7.21: CoNt4g1N
TinFoilSec Presents: Sn3rpOs_v7.21 (CoNt4g1N)
*Updated 11/05/2021 TinfoilSec Presents: Sn3rpOs [Codename: CoNt4g1N] Features: Xfce4 Desktop Kali Linux Full System Torified with Privoxy & Tor bleachbit Wire Signal Veracrypt All repos transported through Privoxy&Tor dnscrypt-proxy (no-logs) Tor Browser Custom Tor Switcher and Pyloris Firefox-esr (configured with tor) Thunderbird ProtonVPN (Free VPN no-logs) Sn1per Vault Scanner RED_HAWK Fork of Kali Rolling, Debian Stretch/Buster -No Back Doors- Now with UEFI boot support and of course bacon. ... -
25
youtube-dl
Download videos from YouTube (and more sites)
youtube-dl is a command-line program to download videos from YouTube and a few more sites. It requires the Python interpreter (2.6, 2.7, or 3.2+), and it is not platform specific. We also provide a Windows executable that includes Python. youtube-dl should work in your Unix box, in Windows or in Mac OS X. It is released to the public domain, which means you can modify it, redistribute it or use it however you like. youtube-dl is a powerful, open-source command-line program designed to...
