Search Results for "load balancing"
Sort By:
Showing 235 open source projects for "load balancing"
View related business solutions-
Try Google Cloud Risk-Free With $300 in CreditUse your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
-
Earn up to 16% annual interest with Nexo.Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.
-
1
EPLB
Expert Parallelism Load Balancer
...It uses policies like hierarchical load balancing (grouped experts placed at node and then GPU level) and global load balancing depending on configuration. The logic is implemented in eplb.py and supports predicting placements given estimated expert usage weights. EPLB aims to reduce hot-spotting and ensure more uniform usage of compute resources in large MoE deployments. -
2
GoProxy
High performance proxy server implemented by golang
The GoProxy is a high-performance http proxy, https proxy, socks5 proxy, ss proxy, websocket proxies, tcp proxies, udp proxies, game shield, game proxies. Supports forward proxies, reverse proxy, transparent proxy, internet nat proxies, https proxy load balancing, http proxy load balancing , socks5 proxies load balancing, socket proxy load balancing, ss proxy load balancing, TCP / UDP port mapping, SSH transit, TLS encrypted transmission, protocol conversion, anti-pollution DNS proxy, API authentication, speed limit, limit connection. Reverse proxy to help you expose a local server behind a NAT or firewall to the internet so that you or your visitors can access it directly and easily. ... -
3
Seesaw v2
Seesaw v2 is a Linux Virtual Server based load balancing platform
Seesaw is a software load balancer and traffic director focused on L3/L4 load balancing with high availability and operational simplicity. Built with production reliability in mind, it uses anycast and health-checking to steer traffic to healthy backends while avoiding single points of failure. It supports common load-balancing policies, NAT, and VIP management, and pairs with standard Linux networking primitives for predictable performance. ... -
4
BFE
A modern layer 7 load balancer from baidu
...Future support is planned for HTTP/3. BFE provides an advanced domain-specific language to describe routing rules which are easy to understand and maintain. BFE supports global load balancing and distributed load balancing for zone aware balancing, zone level failure resilience, overload protection etc. BFE provides a rich set of plugins for traffic management, security, observability, etc. BFE includes detailed built-in metrics for all subsystems. BFE writes various logs for trouble shooting, data analysis and visualization. ... -
Go From AI Idea to AI App FastAccess Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
-
5
Eureka
AWS Service registry for resilient mid-tier load balancing
Eureka is a REST (Representational State Transfer) based service that is primarily used in the AWS cloud for locating services for the purpose of load balancing and failover of middle-tier servers. t Netflix, Eureka is used for the following purposes apart from playing a critical part in mid-tier load balancing. For aiding Netflix Asgard, an open source service which makes cloud deployments easier, in fast rollback of versions in case of problems avoiding the re-launch of 100's of instances which could take a long time. ... -
6
OpenELB
Load Balancer Implementation for Kubernetes in Bare-Metal, Edge, etc.
OpenELB is an open-source load balancer implementation designed for exposing the LoadBalancer type of Kubernetes services in bare metal, edge, and virtualization environments. In cloud-based Kubernetes clusters, Services are usually exposed by using load balancers provided by cloud vendors. However, cloud-based load balancers are unavailable in bare-metal or on-premise environments. OpenELB allows users to create LoadBalancer Services in bare-metal, edge, and virtualization environments for... -
7
Apache Dubbo
A high performance Java RPC framework
Apache Dubbo is a high performance, lightweight, open source RPC framework written in Java. It offers three key functionalities: interface based remote call, load balancing and fault tolerance, and automatic service registration and discovery. Apache Dubbo is built to support multiple service registries and load balancing strategies right out of the box. Due to its micro-kernel and plugin design it can also be easily extended through third-party implementations. Plenty of companies are using Dubbo, and are helping to continually improve it through Dubbo’s improvement initiative, “Wanted: who’s using dubbo”. -
8
RtspSimpleServer
ready-to-use RTSP / RTMP / LL-HLS / WebRTC server and proxy
...For instance, it's possible to publish a stream with RTSP and read it with HLS. Serve multiple streams at once in separate paths Authenticate users; use internal or external authentication. Redirect readers to other RTSP servers (load balancing) Query and control the server through an HTTP API. Reload the configuration without disconnecting existing clients (hot reloading) Read Prometheus-compatible metrics. Run external commands when clients connect, disconnect, read or publish streams. Natively compatible with the Raspberry Pi Camera. Compatible with Linux, Windows and macOS, does not require any dependency or interpreter. -
9
PgDog
PostgreSQL connection pooler, load balancer and database sharder
...In practice, the tool helps organizations scale PostgreSQL clusters while maintaining reliability and predictable performance under load. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
pgcat
PostgreSQL pooler with sharding, load balancing and failover support
PgCat is a high-performance PostgreSQL connection pooler and load balancer built for modern, distributed systems. Written in Rust, PgCat is designed to efficiently manage database connections across multiple shards and replicas while supporting features like automatic failover, query-based routing, and observability. It works with both single-node and multi-tenant Postgres setups, making it ideal for cloud-native applications that require scale and reliability. -
11
Cilium
eBPF-based networking, security, and observability
Cilium is open-source software for providing, securing and observing network connectivity between container workloads, cloud-native, and fueled by the revolutionary Kernel technology eBPF. Kubernetes doesn't come with an implementation of Load Balancing. This is usually left as an exercise for your cloud provider or in private cloud environments an exercise for your networking team. Cilium can attract this traffic with BGP and accelerate leveraging XDP and eBPF. Together these technologies provide a very robust and secure implementation of Load Balancing. Cilium and eBPF operate at the kernel layer. ... -
12
ClickHouse Go
Golang driver for ClickHouse
...Database/sql supports http protocol for transport. (Experimental). Marshal rows into structs (ScanStruct, Select). Unmarshal struct to row (AppendStruct). Connection pool Failover and load balancing. Bulk write support (for database/sql use begin->prepare->(in loop exec)->commit). AsyncInsert, named and numeric placeholders support. LZ4/ZSTD compression support. External data. -
13
Ballast is a tool for balancing user load across SSH servers that supports user-specific policies as well as traditional policies based on metrics such as CPU load. It includes a simple client, a lightweight data server, and a data collection agent.
-
14
CoreDNS
CoreDNS is a DNS server that chains plugins
...Serve zone data from a file; both DNSSEC (NSEC only) and DNS are supported (file and auto). Retrieve zone data from primaries, i.e., act as a secondary server (AXFR only) (secondary). Sign zone data on-the-fly (dnssec). Load balancing of responses (loadbalance). Allow for zone transfers, i.e., act as a primary server (file + transfer). Automatically load zone files from disk (auto). -
15
MsQuic
Cross-platform, C implementation of the IETF QUIC protocol
...Exchange application data in the first round trip (0-RTT). Improved congestion control and loss recovery. Survives a change in the clients IP address or port. Stateless load balancing. -
16
Npgsql
Npgsql is the .NET data provider for PostgreSQL
Npgsql is an open source ADO.NET Data Provider for PostgreSQL, it allows programs written in C#, Visual Basic, F# to access the PostgreSQL database server. It is implemented in 100% C# code, is free and is open source. An Entity Framework Core provider is also available and exposes some features unique to the PostgreSQL database to EF Core users. Finally, a legacy Entity Framework 6.x (non-Core) provider is also available but is no longer being actively maintained. Npgsql is the open source... -
17
ClawRouter
Smart LLM router
ClawRouter is a flexible networking and routing framework designed to support AI-oriented distributed systems and agent ecosystems by managing how messages, requests, and responses are routed between components. It provides a programmable router abstraction that can handle complex traffic patterns, enabling dynamic message forwarding, load balancing, and custom routing logic based on content, context, or policy rules. Because distributed AI systems often involve many services, agents, and runtime components interacting with each other and with external APIs, ClawRouter helps ensure that communication paths remain clear, efficient, and adaptable as systems scale. The framework supports plugin-based extensions so developers can define custom protocols, transformation hooks, and monitoring handlers without modifying core routing logic. ... -
18
Kong
The Cloud-Native API Gateway
...When building for the web, mobile, or Internet of Things, you’ll need a common functionality to run your software, and Kong is that solution. Kong acts as a gateway, connecting microservices requests and APIs natively while also providing load balancing, logging, monitoring, authentication, rate-limiting, and so much more through plugins. Kong is highly extensible as well as platform agnostic, connecting APIs across different environments, platforms and patterns. Achieve architectural freedom with Kong today. -
19
Xray Core
Xray, Penetrates Everything. Also the best v2ray-core
Xray-core is an enhanced superset of v2ray-core, providing a high-performance privacy proxy framework supporting XTLS. It offers full compatibility with v2ray configs, supports multiple protocols, advanced routing, and is distributed as a single executable. -
20
AxonHub
Use any SDK to call 100+ LLMs
...AxonHub translates requests from one provider’s API format into another, enabling seamless interoperability across different AI platforms. The system also provides infrastructure features such as request routing, failover mechanisms, load balancing, and cost management for AI applications. This architecture makes it easier to experiment with multiple models and manage production deployments that rely on several providers simultaneously. -
21
Sing-box
The universal proxy platform
Sing-box is a universal proxy platform written in Go with support for servers and clients across platforms. It handles multiple proxy protocols with advanced routing, supports TUN-based transparent proxying, and offers both CLI and native graphical clients. -
22
DeepSeek-V3
Powerful AI language model (MoE) optimized for efficiency/performance
DeepSeek-V3 is a robust Mixture-of-Experts (MoE) language model developed by DeepSeek, featuring a total of 671 billion parameters, with 37 billion activated per token. It employs Multi-head Latent Attention (MLA) and the DeepSeekMoE architecture to enhance computational efficiency. The model introduces an auxiliary-loss-free load balancing strategy and a multi-token prediction training objective to boost performance. Trained on 14.8 trillion diverse, high-quality tokens, DeepSeek-V3 underwent supervised fine-tuning and reinforcement learning to fully realize its capabilities. Evaluations indicate that it outperforms other open-source models and rivals leading closed-source models, achieving this with a training duration of 55 days on 2,048 Nvidia H800 GPUs, costing approximately $5.58 million. -
23
LoLLMs Hub Fortress
A proxy server for multiple ollama instances with Key security
...This design allows organizations to scale horizontally, combining local hardware, cloud resources, and specialized inference servers into a unified infrastructure. LoLLMs Hub also introduces intelligent routing mechanisms that automatically select the most appropriate model based on rules such as priority, load balancing, or availability, improving efficiency and reliability. -
24
gost
GO Simple Tunnel, a simple tunnel written in golang
...Support multiple tunnel types, tunnel UDP over TCP. Local/remote TCP/UDP port forwarding, TCP/UDP Transparent proxy, Shadowsocks Protocol (TCP/UDP), and SNI Proxy. Permission control, load balancing, route control, DNS resolver and proxy, and TUN/TAP Device. In GOST, GOST and other proxy services are considered as proxy nodes, GOST can handle the requests itself, or forward the requests to any one or more proxy nodes. In addition to configuring services directly from the command line, parameters can also be set by specifying the external configuration file with the -C parameter. -
25
Quartz.NET
Quartz enterprise scheduler .NET
...Built-in support for load balancing your work and graceful fail-over. Applications can catch scheduling events to monitor or control job/trigger behavior by implementing one or more listener interfaces.
