Search Results for "linux proxy scraper" - Page 8
Sort By:
Showing 1379 open source projects for "linux proxy scraper"
View related business solutions-
Veeam Data Platform v13.1Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
tumblr-crawler
Python crawler to download photos and videos from Tumblr blogs
tumblr-crawler is an open source Python-based utility designed to download media content from Tumblr blogs. It provides a script that automatically retrieves photos and videos from specified Tumblr sites and saves them locally for offline access. Users can specify one or multiple blogs to crawl by editing a configuration file or by passing parameters through the command line. Once executed, the script fetches media from the Tumblr API and stores the downloaded files in folders named after... -
2
Pomerium
Pomerium is an identity and context-aware access proxy
Secure, context-aware access that just works. Access internal resources securely. Implement zero trust. Achieve compliance. All without the headache of a VPN. For teams that prefer a hosted solution while keeping data governance. For organizations that need advanced scaling, access control, and governance capabilities. IT and developers need a scalable access control solution to keep users productive, happy, and secure. Pomerium uses identity and context to ensure secure access to internal... -
3
TscanPlus
Network security detection and operation and maintenance tool
TscanPlus is a comprehensive network-security assessment and operations platform for discovering, classifying, and reviewing enterprise assets. It combines information gathering, port discovery, service identification, web fingerprinting, vulnerability verification, directory discovery, and domain enumeration in one interface. A large fingerprint database helps identify web systems and automatically associate relevant security checks with discovered technologies. Project management features... -
4
Xata Agent
AI agent expert in PostgreSQL
Xata Agent is a local development tool that provides a seamless integration experience for developers working with Xata, a serverless database platform. It runs a local proxy that mimics production behavior, allowing developers to test and develop with local credentials, preview branches, and schema changes. The agent is built for productivity, enabling tight CLI and Git integration for data workflows. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
Emissary-ingress
open source Kubernetes-native API gateway for microservices
Emissary-Ingress is the most popular API Gateway Kubernetes-native - open-source, that delivers scalability, flexibility, and simplicity for some of the world's largest Kubernetes installations. Emissary-Ingress is an open source CNCF incubating project, and it uses the ubiquitous Envoy Proxy at its core. Once your organization hits a certain scale, a reverse proxy or load balancer isn’t enough for traffic management. If you’re using Kubernetes, you’re probably already at that scale and need... -
6
Browser Use
Make websites accessible for AI agents
Browser Use is an AI-powered browser automation framework designed to let agents interact with websites just like humans do. It enables developers and AI systems to perform complex online tasks such as form filling, data extraction, and navigation through natural language instructions. Built with Python and compatible with modern LLMs, it integrates seamlessly with tools like ChatBrowserUse, Google Gemini, and Anthropic models. The platform supports both open-source deployment and a fully... -
7
Open Source API Firewall by Wallarm
Fast and light-weight API proxy firewall for request and response
API Firewall is a high-performance proxy with API request and response validation based on OpenAPI/Swagger schema. It is designed to protect REST API endpoints in cloud-native environments. API Firewall provides API hardening with the use of a positive security model allowing calls that match a predefined API specification for requests and responses, while rejecting everything else. -
8
Kali-Proxy is a System-wide Proxy Manager for Kali Linux (XFCE) System Tray Icon must be run as root. Lives in the XFCE system tray. Right-click to access all options. Icon colours indicate current proxy state: White No proxy active Red SOCKS proxy active Purple Tor routing active Orange Transparent proxy active SOCKS4 / SOCKS5 Proxy Routes traffic through a SOCKS4 or SOCKS5 proxy of your choice. ...
-
9
Dozzle
Realtime log viewer for containers. Supports Docker, Swarm and K8s
Dozzle is a lightweight, self-hosted web application for real-time viewing and monitoring of container logs, focused on speed and simplicity rather than building a full log storage pipeline. Instead of indexing or storing logs, it connects to your container runtime and streams live output so you can diagnose issues as they happen. The interface includes practical quality-of-life features like fuzzy searching for containers, regex log search, split-screen viewing for multiple logs, and live... -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
10
autocrawler
Multiprocess Selenium crawler for downloading images by keywords
AutoCrawler is a Python-based image crawling tool designed to automatically download large numbers of images from search engines using automated browser interaction. It uses Selenium and a Chrome browser driver to navigate image search pages and collect image sources based on keywords provided by the user. AutoCrawler supports multiprocess and multithreaded downloading, which allows it to retrieve images faster by running several tasks simultaneously. Users provide search terms through a... -
11
Toxic
A Tox-based instant messaging and video chat client
Toxic is a Tox protocol-based command-line messenger for Linux, offering fully encrypted, decentralized, and serverless instant messaging. It includes features such as text messaging, file transfer, and audio calls—all without requiring user accounts or central servers. Toxic is designed for power users who prefer a minimalist interface, operating entirely within a terminal while delivering strong privacy through the Tox peer-to-peer protocol. It’s lightweight, fast, and ideal for use in... -
12
v2flyNG
A V2Ray client for Android, support v2fly core
v2flyNG is a mobile client that packages the V2Ray/V2Fly networking core into an Android application with a touch-friendly UI. It focuses on making modern protocols—such as VMess, VLESS, and Trojan—accessible without requiring shell access or manual config editing. Profiles can be added via subscription links or QR codes, and the app merges and updates them on schedule to keep node lists fresh. Per-app proxy controls allow you to include or exclude specific applications, which is useful for... -
13
BurpSuite for Pentester
This cheatsheet is built for the Bug Bounty Hunters
BurpSuite for Pentester is a structured learning repository for web application security testing with Burp Suite. It is designed for penetration testers, bug bounty researchers, and learners who want a practical reference for Burp's major capabilities. The collection explains how different tools fit into vulnerability discovery, request analysis, and testing workflows. Covered areas include Proxy, Repeater, Intruder, Scanner, Sequencer, Collaborator, and several popular extensions.... -
14
ChatGPT2API
The reverse implementation of the ChatGPT official website interface
ChatGPT2API is a proxy service that converts ChatGPT web interactions into an API-compatible interface, enabling programmatic access to chat functionality. It allows developers to integrate ChatGPT-like capabilities into applications without relying directly on official APIs. The system works by bridging browser-based sessions with API-style endpoints, translating requests and responses seamlessly. It supports features such as conversation continuity and parameter customization. The project... -
15
The Lura Project framework
Ultra performant API Gateway with middlewares
An extendable, simple and stateless high-performance API Gateway framework designed for both cloud-native and on-prem setups. Consumers of REST API content (specially in microservices) often query backend services that weren’t coded for the UI implementation. This is of course a good practice, but the UI consumers need to do implementations that suffer a lot of complexity and burden with the sizes of their microservices responses. Lura is an API Gateway builder and proxy generator that sits... -
16
linkedin2username
Generate probable usernames from LinkedIn company employee lists
linkedin2username is an open source OSINT (Open Source Intelligence) tool designed to generate lists of potential usernames by scraping employee information from a company’s LinkedIn page. It logs into LinkedIn using valid user credentials and collects publicly visible employee names associated with a specified organization. Using these names, it automatically generates multiple possible username formats that organizations commonly use for accounts or email addresses. This process helps... -
17
Lepton
A lean snippet manager
...Lepton replies on GitHub APIs to detect the language. Build apps for macOS, Windows and Linux. -
18
Camellia
Camellia provide easy-to-use server toolkits
Camellia was originally developed as the basic architecture for netease-yunxin's servers, all the modules are running in netease-yunxin's online env. -
19
paqet
Ferries Packets Across Forbidden Boundaries
paqet is a bidirectional packet-level proxy that transports traffic over raw packets instead of relying on the host operating system’s normal TCP/IP stack. It forwards traffic between a local client and a remote server using KCP as the reliable transport layer. The project is written in Go and is aimed at users who need a low-level tunnel that can operate in restricted or heavily filtered network environments. It is described as an alpha-stage tool, so compatibility and protocol behavior may... -
20
edgetunnel
edgetunnel 2.0 VLESS/Trojan
edgetunnel is a modified version of a serverless tunnelling solution designed to run on platforms like Cloudflare Workers and Pages, enabling protocols such as VLESS and Trojan to be exposed through edge-functions rather than traditional servers. The project’s fork by cmliu emphasizes conversion of protocol configuration (especially VLESS) into subscription links, so that users can deploy and then generate “Clash” or “Sing-box” compatible subscription content easily. It provides a... -
21
Cntlm is an NTLM / NTLMv2 authenticating HTTP/1.1 proxy. It caches auth'd connections for reuse, offers TCP/IP tunneling (port forwarding) thru parent proxy and much much more. It's in C, very fast and resource-efficient. Go to http://cntlm.sf.net/
-
22
AIOStreams
One addon to rule them all
AIOStreams is a “super-add-on” for Stremio that consolidates results from many add-ons and debrid services into a single, customizable feed. Instead of juggling multiple add-ons, you point AIOStreams at them; it then queries, merges, de-duplicates, and re-ranks everything according to your rules. The project includes a powerful filtering and sorting engine—think conditions on resolution, codec, provider, cached status, seed count, and more—so power users can shape results precisely. It also... -
23
Cariddi
Take a list of domains, crawl urls and scan for endpoints, secrets
Cariddi is a Go-based web reconnaissance crawler for authorized security testing and application analysis. It accepts one or many domains and recursively explores reachable URLs. During crawling, it can identify interesting endpoints, file extensions, tokens, secrets, API keys, and other potentially sensitive patterns. Custom regular expressions let researchers extend secret detection for organization-specific data. Concurrency, delays, timeouts, caching, user-agent controls, and proxy... -
24
learn_python3_spider
Python crawler tutorial series, learning Python crawlers from 0 to 1
learn_python3_spider is a tutorial and example-code collection for learning web scraping with Python 3 from beginner to advanced topics. It introduces request capture, browser and mobile traffic inspection, and core scraping libraries such as Requests, BeautifulSoup, Selenium, Appium, and Scrapy. Lessons also cover JSON parsing, regular expressions, concurrency, proxy usage, login handling, and CAPTCHA-related techniques. Data can be stored with CSV, MySQL, or MongoDB examples. More advanced... -
25
HTTPLeaks
All possible ways, a website can leak HTTP requests
HTTPLeaks is a security test project that catalogs ways HTML can cause a browser or renderer to send external HTTP requests. Its primary artifact is a single HTML file containing many combinations of elements and attributes that may trigger network activity. Researchers can use it to evaluate Content Security Policy enforcement, webmail sanitization, proxy rewriting, and privacy controls. The project highlights cases where opening content may unexpectedly disclose that it was viewed or...
