Search Results for "linux proxy scraper" - Page 12
Sort By:
Showing 712 open source projects for "linux proxy scraper"
View related business solutions-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
HTTP adapter
A lightweight and extensible HTTP adapter, editable HTTP server
A lightweight and extensible HTTP adapter, editable HTTP server, Webhook transformation, and request relay platform. Just route, filter, validate, transform, relay and response to your HTTP requests. Setup your HTTP server in 3 minutes with a few YAML configurations and a few TS/JS code snippets. -
2
django-dynamic-scraper
Creating Scrapy scrapers via the Django admin interface
Django Dynamic Scraper (DDS) is an app for Django build on top of the scraping framework Scrapy. While preserving many of the features of Scrapy it lets you dynamically create and manage spiders via the Django admin interface. With Django Dynamic Scraper (DDS) you can define your Scrapy scrapers dynamically via the Django admin interface and save your scraped items in the database you defined for your Django project. Since it simplifies things DDS is not usable for all kinds of scrapers, but... -
3
PivotSuite
Network Pivoting Toolkit
PivotSuite is a portable, platform-independent and powerful network pivoting toolkit, Which helps Red Teamers / Penetration Testers to use a compromised system to move around inside a network. It is a Standalone Utility, Which can use as a Server or as a Client. If the compromised host is directly accessible (Forward Connection) from Our pentest machine, Then we can run pivotsuite as a server on the compromised machine and access the different subnet hosts from our pentest machine, Which was... -
4
ProxyBroker
Asynchronous tool for finding and checking public proxy servers
ProxyBroker is an open source Python tool designed to automatically discover and verify public proxy servers from many online sources. It operates asynchronously, allowing it to gather and test large numbers of proxies efficiently while performing multiple checks concurrently. It collects proxy addresses from dozens of providers and evaluates whether they are functional and suitable for use. It supports several proxy protocols, including HTTP, HTTPS, SOCKS4, and SOCKS5, making it flexible... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
5
Kitsunebi
A fully-featured V2Ray client for Android
A fully-featured V2Ray client for Android. The Core used by Kitsunebi extends the function of v2ray-core, and adds a strategy of selecting the fastest node according to the node delay value. You can add a node group on the graphical interface to enable it. If you use custom configuration, there are several configuration items, except for tolerance. The delay test is not ICMP Ping or TCP Ping, the method used is roughly the same as that used by the latency strategy in load balancing, actually... -
6
WebExtractServer
WebExtractServer use with WebExtractLte for use with web browsers
Browse data, fetched by WebExtractLte directly in your browser. Designed to be used with Webscraper (webscraper.io) - third party web scraper tool, available as plugin for Chrome and Firefox. -
7
Gzip Handler
Go middleware to gzip HTTP responses
This is a tiny Go package that wraps HTTP handlers to transparently gzip the response body, for clients which support it. Although it's usually simpler to leave that to a reverse proxy (like nginx or Varnish), this package is useful when that's undesirable. Call GzipHandler with any handler (an object which implements the http.Handler interface), and it'll return a new handler which gzips the response. -
8
Jupyter Server Proxy
Jupyter notebook server extension to proxy web services.
Jupyter Server Proxy lets you run arbitrary external processes (such as RStudio, Shiny Server, Syncthing, PostgreSQL, Code Server, etc) alongside your notebook server and provide authenticated web access to them using a path like /rstudio next to others like /lab. Alongside the Python package that provides the main functionality, the JupyterLab extension (@jupyterhub/jupyter-server-proxy) provides buttons in the JupyterLab launcher window to get to RStudio for example. -
9
Whonix
Whonix is an Anonymous Operating System.
THIS IS NOT WHONIX'S HOMEPAGE. Please go to: https://www.whonix.org/ (This is only Whonix's sourceforge must-have project page.) Whonix is an operating system focused on anonymity, privacy and security. It's based on the Tor anonymity network, Debian GNU/Linux and security by isolation. DNS leaks are impossible, and not even malware with root privileges can find out the user's real IP. Whonix consists of two parts: One solely runs Tor and acts as a gateway, which we call... -
Secure File Transfer for Windows with Cerberus by RedwoodCerberus supports unlimited users and connections on a single IP, with built-in encryption, 2FA, and a browser-based web client — all deployable in under 15 minutes with a 25-day free trial.
-
10
Scrupless
The code behind www.scrupless.net
The reverse proxy sitting behind http://www.scrupless.net doing dynamic rewrites of arbitrary live sites. -
11
bullet-proxy
Bullet proxy: A free proxy
1.A free http Proxy . 2. Open http://144.34.227.196:8281/home and sign in ， you will got 10GB/Month for free; 3. For window user ，the local proxy server IP Address is 127.0.0.1, Port is 10000. you can set the proxy by yourself according to this article https://www.howtogeek.com/tips/how-to-set-your-proxy-settings-in-windows-8.1/ -
12
Firefly
A proxy software to help circumventing the Great Firewall
Firefly is an agent used to access Great Firewall (GFW) blocked websites and applications. Under the default settings, Firefly only goes through VPN forwarding wall of IP traffic, IP wall straight. If you find a website or application you cannot access, Firefly flow mechanism can be built to distinguish between an error. In this case, you can choose to forward all traffic through the VPN, and then try again. -
13
GSnova
Private proxy solution & network troubleshooting tool
GSnova is a high-performance proxy tool for bypassing internet censorship and securing network traffic through a range of supported transport protocols. It acts as a multi-protocol client/server proxy that can tunnel traffic over TLS, WebSocket, KCP, QUIC, and SSH. GSnova is optimized for resilience and speed under restrictive network conditions and supports multiple fronting strategies and obfuscation techniques. It's particularly suited for users in highly censored environments and... -
14
PHP WebSocket server
PHP WebSocket server
Simple and multifunctional PHP WebSocket server. -
15
mzitu
Python crawler that downloads image galleries and analyzes titles
mzitu is a Python-based web crawling project designed to automatically download and organize image galleries from a specific photography site. It demonstrates how to build a scraper that navigates gallery pages, retrieves image links, and saves the images locally in a structured directory layout. It focuses on automating the collection of large sets of images by programmatically parsing page content and iterating through gallery entries. mzitu also includes a simple analysis script that... -
16
Swagger-to-GraphQL
Swagger to GraphQL API adapter
Swagger-to-GraphQL converts your existing Swagger schema to an executable GraphQL schema where resolvers perform HTTP calls to certain real endpoints. It allows you to move your API to GraphQL with nearly zero effort and maintain both REST and GraphQL APIs. Our CLI tool also allows you get the GraphQL schema in Schema Definition Language. This library will fetch your swagger schema, convert it to a GraphQL schema and convert GraphQL parameters to REST parameters. From there you are control... -
17
hiproxy
hiproxy is a lightweight proxy tool for Front-End developers
hiproxy is a lightweight web proxy tool based on Node.js. The primary purpose of hiproxy is to solve the problem of host management and reverse proxy needs of developers. For example, if you are working as a team and each of the developers in the team need a different proxy setting, you will no longer need to modify your hosts file or use a web server like Nginx as a reverse proxy. hiproxy extends the syntax of hosts file to support port numbers. Besides, hiproxy also supports configuration... -
18
haipproxy
Distributed proxy IP pool for web crawlers using Scrapy and Redis
HAipproxy is a distributed proxy IP pool system designed to collect, manage, and provide large numbers of proxy addresses for web crawling tasks. It automatically crawls proxy resources from the internet and aggregates them into a centralized pool that can be accessed by distributed spiders and scraping systems. It is built using Python and relies on Scrapy for high-performance crawling while Redis is used for data storage, communication, and task coordination between components. It includes... -
19
mod_tunnel is a simple Apache 1.3.x module that can be used to create TCP tunnels using your web server. It comes handy to expose services which can be reached through a proxy, bypassing firewalls.
-
20
Mini Psiphon Launcher with auto Reconnect in ~Mb. You can combine it with SSH, Proxifier and other to tunnel your connection or use own forwarder. #New Version: V-1.4
-
21
cpDetector is a proxy for codepage detection of documents. It delegates to multiple instances that try to detect the codepage by different techinques. A command line executeable is shipped that allows to sort documents by codepage.
-
22
Lanproxy
Intranet penetration tool that proxies local area network computers
Lanproxy is an intranet penetration tool that proxies local area network personal computers and servers to the public network. It supports tcp traffic forwarding and any tcp upper layer protocol (access to intranet websites, local payment interface debugging, ssh access, remote desktop, http proxy) , https proxy, socks5 proxy...). Penetration basic functions, same as the open source version, high performance, can support tens of thousands of penetration connections at the same time. Support... -
23
Go HTTP tunnel
Fast and secure tunnels over HTTP/2
Go HTTP tunnel is a reverse tunnel based on HTTP/2. It enables you to share your local host when you don't have a public IP. The tunnel client tunnel requires a configuration file, by default it will try reading tunnel.yml in your current working directory. If you want to specify other file use -config flag. A client opens TLS connection to a server. The server accepts connections from known clients only. The client is recognized by its TLS certificate ID. The server is publicly available... -
24
mod_auth_trustheader
apache-2.x module to get userid from header|environment|SSL variable
Mostly copied from mod_auth_basic of apache-2.2. The basic-auth handshake was replaced by some code which gets the userid out of a customable variable. The variable could be anything ap_expr could read in authentication hook, e.g.: a header field, a httpd environment variable or an SSL environment variable. The syntax is the same known from RewriteCond of mod_rewrite: e.g.: %{HTTP:variable}, %{ENV:variable} or %{SSL:variable} No password is written into internal httpd variables. So... -
25
CloudFlare IP Ranges
The list of CloudFlare IPs (IP ranges) to be used in the "trust proxy"
The list of CloudFlare IPs (IP ranges) to be used in the trust proxy configurations.
