Search Results for "load balancer"

Paddler is an open-source LLM infrastructure platform designed to deploy, manage, and scale large language models on private infrastructure. The system acts as a specialized load balancer and serving layer for language models, enabling organizations to run inference workloads without relying on external API providers. It supports running models locally through engines such as llama.cpp while distributing requests across multiple compute nodes to improve performance and reliability. The architecture is designed with privacy and cost control in mind, making it suitable for organizations that handle sensitive data or require predictable operational costs. ...

EPLB is DeepSeek’s open implementation of a load balancing algorithm designed for expert parallelism (EP) settings in MoE architectures. In EP, different “experts” are mapped to different GPUs or nodes, so load imbalance becomes a performance bottleneck if certain experts are invoked much more often. EPLB solves this by duplicating heavily used experts (redundancy) and then placing those duplicates across GPUs to even out computational load. It uses policies like hierarchical load balancing...

...Let's embrace the reality, we almost always have to deal with more than one protocol. It was once Thrift, today it's gRPC, and REST never gets old. At the same time, you sometimes have to handle health check requests from a load balancer or even serve some static files. Armeria is capable of running services using different protocols, all on a single port. No need for any proxies or sidecars. Enjoy the reduced complexity and points of failure, even when migrating between protocols!

OpenAS2 is a java-based implementation of the EDIINT AS2 standard. It is intended to be used as a server. It is extremely configurable and supports a wide variety of signing and encryption algorithms. Supports very high traffic volume allowing parallel processing of files per partner. SUPPORT: Please use the Github issues and Discussions channels here: https://github.com/OpenAS2/OpenAs2App/ Requirements: - Java 11 or newer (tested with the LTS versions of Java up to 21) ...

This project is about to give you a simple (but powerful) loadbalancer written in JAVA. "The performance of a Java based load balancer may never match that of a well written load balancer in C/C++, but as teh platform is evolves further, it can only get better." (from http://javalb.sourceforge.net/) My project is a mutch more simple way to have a TCP loadbalancer. It has a hard coded round robin (tictoc) algorythm, and (right now) limited to 2 realservers (it will change in the future)

Zebra_Session is a PHP class that acts as a wrapper for PHP's default session handling functions but instead of storing session data in flat files it stores them in a MySQL database, thus providing both better security and better performance. The library is also a solution for applications that are scaled across multiple web servers (using a load balancer or a round-robin DNS) and where the user's session data needs to be available. Storing sessions in a database makes them available to all of the servers! Zebra_Session's code is heavily commented and generates no warnings/errors/notices when PHP's error reporting level is set to E_ALL. Starting with version 2.0, Zebra_Session implements row locks, ensuring that data is correctly handled in a scenario with multiple concurrent AJAX requests.

Elastica is a highly efficient and extensible, rules-based load-balancer for JBoss that adds dynamic behavior to EJB load balancing. Rules can be defined to redirect EJB requests according to request data, server performance data, or even the time of day

Software load balancer. Accepts connections and distributes them to an array of back end servers. Unique/advanced features include integrated testing of back end servers and optional termination of client connections to misfunctioning servers.

The project is a fully functional Java based IP load balancer. It has a web based admin UI to setup the configuration such as the number of real servers and their addressess, ping times to monitor the health of each of the real servers, the protocols supp

OpenLoadMon is a load monitor for Apache proxy balancer. It can obtain the runtime load info from back-end servers, calculate the dynamic load factors, and pass them to the Apache proxy balancer. It implements a general framework for various web servers