Search Results for "load balancer"

Paddler is an open-source LLM infrastructure platform designed to deploy, manage, and scale large language models on private infrastructure. The system acts as a specialized load balancer and serving layer for language models, enabling organizations to run inference workloads without relying on external API providers. It supports running models locally through engines such as llama.cpp while distributing requests across multiple compute nodes to improve performance and reliability. The architecture is designed with privacy and cost control in mind, making it suitable for organizations that handle sensitive data or require predictable operational costs. ...

EPLB is DeepSeek’s open implementation of a load balancing algorithm designed for expert parallelism (EP) settings in MoE architectures. In EP, different “experts” are mapped to different GPUs or nodes, so load imbalance becomes a performance bottleneck if certain experts are invoked much more often. EPLB solves this by duplicating heavily used experts (redundancy) and then placing those duplicates across GPUs to even out computational load. It uses policies like hierarchical load balancing...

...Let's embrace the reality, we almost always have to deal with more than one protocol. It was once Thrift, today it's gRPC, and REST never gets old. At the same time, you sometimes have to handle health check requests from a load balancer or even serve some static files. Armeria is capable of running services using different protocols, all on a single port. No need for any proxies or sidecars. Enjoy the reduced complexity and points of failure, even when migrating between protocols!

OpenAS2 is a java-based implementation of the EDIINT AS2 standard. It is intended to be used as a server. It is extremely configurable and supports a wide variety of signing and encryption algorithms. Supports very high traffic volume allowing parallel processing of files per partner. SUPPORT: Please use the Github issues and Discussions channels here: https://github.com/OpenAS2/OpenAs2App/ Requirements: - Java 11 or newer (tested with the LTS versions of Java up to 21) ...

This is Pen, a load balancer for udp and tcp based protocols such as dns, http or smtp. It allows several servers to appear as one to the outside and automatically detects servers that are down and distributes clients among the available servers. This gives high availability and scalable performance.

LBActive is an dynamic and active load balancer health check system written in Python. Currently it supports only Nginx. LBActive dynamically adjusts the weight of a weighted round robin or ip hash Nginx load balancer by retrieving the current load on each backend server. The next release will move to a more modular approach to enable support for other load balancers that do not have dynamic and/or active checks and other types of backend checks if needed.

This project is about to give you a simple (but powerful) loadbalancer written in JAVA. "The performance of a Java based load balancer may never match that of a well written load balancer in C/C++, but as teh platform is evolves further, it can only get better." (from http://javalb.sourceforge.net/) My project is a mutch more simple way to have a TCP loadbalancer. It has a hard coded round robin (tictoc) algorythm, and (right now) limited to 2 realservers (it will change in the future)

Zebra_Session is a PHP class that acts as a wrapper for PHP's default session handling functions but instead of storing session data in flat files it stores them in a MySQL database, thus providing both better security and better performance. The library is also a solution for applications that are scaled across multiple web servers (using a load balancer or a round-robin DNS) and where the user's session data needs to be available. Storing sessions in a database makes them available to all of the servers! Zebra_Session's code is heavily commented and generates no warnings/errors/notices when PHP's error reporting level is set to E_ALL. Starting with version 2.0, Zebra_Session implements row locks, ensuring that data is correctly handled in a scenario with multiple concurrent AJAX requests.

A Load Balancer for a VoIP software on a Mobile Node device that choose among three net interfaces to send packages to an other Load Balancer on a Fixed Node. The LB's aim is to lose the lowest number of packages, choosing the best net interface.

Elastica is a highly efficient and extensible, rules-based load-balancer for JBoss that adds dynamic behavior to EJB load balancing. Rules can be defined to redirect EJB requests according to request data, server performance data, or even the time of day

XLB is a high performance HTTP load balancer. connection management, caching, ssl, scripting. 300 mbit/sec / 4000 reqs/sec takes 30% cpu on a 2GhZ Xeon. connection pooling to backend servers reduces memory and cpu usage on backends.

SQuaLe is a glib based SQL query load balancer over persitent database connections.

This application helps balances incoming TCP connections. This was intended mainly for VNC, but it can be used to balance other types of TCP connections.

We needed an efficient, easy to configure, affordable, reliable, and flexible HTTP(S) load balancer for our three-tier (n*proxy / n*app / n*db) web software. So we wrote it! Configuration managed in apache, with mirroring and monitoring capabilities.

Imbalance is a lightweight redirector that runs as an Apache PHP Script, and a PHP daemon. Imbalance uses a cost based round-robin weighted algorithm to distribute load across web servers with the ability to create user defined cost calculations

Software load balancer. Accepts connections and distributes them to an array of back end servers. Unique/advanced features include integrated testing of back end servers and optional termination of client connections to misfunctioning servers.

The project is a fully functional Java based IP load balancer. It has a web based admin UI to setup the configuration such as the number of real servers and their addressess, ping times to monitor the health of each of the real servers, the protocols supp

OpenLoadMon is a load monitor for Apache proxy balancer. It can obtain the runtime load info from back-end servers, calculate the dynamic load factors, and pass them to the Apache proxy balancer. It implements a general framework for various web servers