Search Results for "load balancing"
Sort By:
Showing 249 open source projects for "load balancing"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
1
EPLB
Expert Parallelism Load Balancer
...It uses policies like hierarchical load balancing (grouped experts placed at node and then GPU level) and global load balancing depending on configuration. The logic is implemented in eplb.py and supports predicting placements given estimated expert usage weights. EPLB aims to reduce hot-spotting and ensure more uniform usage of compute resources in large MoE deployments. -
2
GoProxy
High performance proxy server implemented by golang
The GoProxy is a high-performance http proxy, https proxy, socks5 proxy, ss proxy, websocket proxies, tcp proxies, udp proxies, game shield, game proxies. Supports forward proxies, reverse proxy, transparent proxy, internet nat proxies, https proxy load balancing, http proxy load balancing , socks5 proxies load balancing, socket proxy load balancing, ss proxy load balancing, TCP / UDP port mapping, SSH transit, TLS encrypted transmission, protocol conversion, anti-pollution DNS proxy, API authentication, speed limit, limit connection. Reverse proxy to help you expose a local server behind a NAT or firewall to the internet so that you or your visitors can access it directly and easily. ... -
3
Seesaw v2
Seesaw v2 is a Linux Virtual Server based load balancing platform
Seesaw is a software load balancer and traffic director focused on L3/L4 load balancing with high availability and operational simplicity. Built with production reliability in mind, it uses anycast and health-checking to steer traffic to healthy backends while avoiding single points of failure. It supports common load-balancing policies, NAT, and VIP management, and pairs with standard Linux networking primitives for predictable performance. ... -
4
Eureka
AWS Service registry for resilient mid-tier load balancing
Eureka is a REST (Representational State Transfer) based service that is primarily used in the AWS cloud for locating services for the purpose of load balancing and failover of middle-tier servers. t Netflix, Eureka is used for the following purposes apart from playing a critical part in mid-tier load balancing. For aiding Netflix Asgard, an open source service which makes cloud deployments easier, in fast rollback of versions in case of problems avoiding the re-launch of 100's of instances which could take a long time. ... -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
5
Apache Dubbo
A high performance Java RPC framework
Apache Dubbo is a high performance, lightweight, open source RPC framework written in Java. It offers three key functionalities: interface based remote call, load balancing and fault tolerance, and automatic service registration and discovery. Apache Dubbo is built to support multiple service registries and load balancing strategies right out of the box. Due to its micro-kernel and plugin design it can also be easily extended through third-party implementations. Plenty of companies are using Dubbo, and are helping to continually improve it through Dubbo’s improvement initiative, “Wanted: who’s using dubbo”. -
6
BFE
A modern layer 7 load balancer from baidu
...Future support is planned for HTTP/3. BFE provides an advanced domain-specific language to describe routing rules which are easy to understand and maintain. BFE supports global load balancing and distributed load balancing for zone aware balancing, zone level failure resilience, overload protection etc. BFE provides a rich set of plugins for traffic management, security, observability, etc. BFE includes detailed built-in metrics for all subsystems. BFE writes various logs for trouble shooting, data analysis and visualization. ... -
7
Cilium
eBPF-based networking, security, and observability
Cilium is open-source software for providing, securing and observing network connectivity between container workloads, cloud-native, and fueled by the revolutionary Kernel technology eBPF. Kubernetes doesn't come with an implementation of Load Balancing. This is usually left as an exercise for your cloud provider or in private cloud environments an exercise for your networking team. Cilium can attract this traffic with BGP and accelerate leveraging XDP and eBPF. Together these technologies provide a very robust and secure implementation of Load Balancing. Cilium and eBPF operate at the kernel layer. ... -
8
pgcat
PostgreSQL pooler with sharding, load balancing and failover support
PgCat is a high-performance PostgreSQL connection pooler and load balancer built for modern, distributed systems. Written in Rust, PgCat is designed to efficiently manage database connections across multiple shards and replicas while supporting features like automatic failover, query-based routing, and observability. It works with both single-node and multi-tenant Postgres setups, making it ideal for cloud-native applications that require scale and reliability. -
9
RtspSimpleServer
ready-to-use RTSP / RTMP / LL-HLS / WebRTC server and proxy
...For instance, it's possible to publish a stream with RTSP and read it with HLS. Serve multiple streams at once in separate paths Authenticate users; use internal or external authentication. Redirect readers to other RTSP servers (load balancing) Query and control the server through an HTTP API. Reload the configuration without disconnecting existing clients (hot reloading) Read Prometheus-compatible metrics. Run external commands when clients connect, disconnect, read or publish streams. Natively compatible with the Raspberry Pi Camera. Compatible with Linux, Windows and macOS, does not require any dependency or interpreter. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
PgDog
PostgreSQL connection pooler, load balancer and database sharder
...In practice, the tool helps organizations scale PostgreSQL clusters while maintaining reliability and predictable performance under load. -
11
MsQuic
Cross-platform, C implementation of the IETF QUIC protocol
...Exchange application data in the first round trip (0-RTT). Improved congestion control and loss recovery. Survives a change in the clients IP address or port. Stateless load balancing. -
12
CoreDNS
CoreDNS is a DNS server that chains plugins
...Serve zone data from a file; both DNSSEC (NSEC only) and DNS are supported (file and auto). Retrieve zone data from primaries, i.e., act as a secondary server (AXFR only) (secondary). Sign zone data on-the-fly (dnssec). Load balancing of responses (loadbalance). Allow for zone transfers, i.e., act as a primary server (file + transfer). Automatically load zone files from disk (auto). -
13
Sub2API
Sub2API-CRS2 is a one-stop open source transit service
...It allows users to create platform-issued API keys while routing requests to upstream AI services behind the scenes. The platform handles authentication, quota allocation, billing logic, load balancing, and request forwarding, making it useful for shared or team-based access management. It is designed to unify access to services such as Claude, OpenAI, Gemini, and related AI tools through a centralized relay layer. Sub2API supports deployment through Docker Compose or binary installation for Linux servers. Its main value is turning multiple subscription-based AI accounts into a managed API access platform with administrative controls. -
14
AxonHub
Use any SDK to call 100+ LLMs
...AxonHub translates requests from one provider’s API format into another, enabling seamless interoperability across different AI platforms. The system also provides infrastructure features such as request routing, failover mechanisms, load balancing, and cost management for AI applications. This architecture makes it easier to experiment with multiple models and manage production deployments that rely on several providers simultaneously. -
15
ClickHouse Go
Golang driver for ClickHouse
...Database/sql supports http protocol for transport. (Experimental). Marshal rows into structs (ScanStruct, Select). Unmarshal struct to row (AppendStruct). Connection pool Failover and load balancing. Bulk write support (for database/sql use begin->prepare->(in loop exec)->commit). AsyncInsert, named and numeric placeholders support. LZ4/ZSTD compression support. External data. -
16
Npgsql
Npgsql is the .NET data provider for PostgreSQL
Npgsql is an open source ADO.NET Data Provider for PostgreSQL, it allows programs written in C#, Visual Basic, F# to access the PostgreSQL database server. It is implemented in 100% C# code, is free and is open source. An Entity Framework Core provider is also available and exposes some features unique to the PostgreSQL database to EF Core users. Finally, a legacy Entity Framework 6.x (non-Core) provider is also available but is no longer being actively maintained. Npgsql is the open source... -
17
WeChat-AI
Self-hosted WeChat role-playing conversation service
...Administrators receive dashboards for users, bots, token usage, deployment nodes, and sticker moderation. The platform supports visual Chatflow orchestration, multi-node deployment with shared Redis, Cloudflare load balancing, and incremental OTA updates. -
18
Xray Core
Xray, Penetrates Everything. Also the best v2ray-core
Xray-core is an enhanced superset of v2ray-core, providing a high-performance privacy proxy framework supporting XTLS. It offers full compatibility with v2ray configs, supports multiple protocols, advanced routing, and is distributed as a single executable. -
19
Go Micro
A framework for distributed systems development
Go Micro is a framework for distributed systems development. Go Micro provides the core requirements for distributed systems development including RPC and Event driven communication. The Micro philosophy is sane defaults with a pluggable architecture. We provide defaults to get you started quickly but everything can be easily swapped out. Auth is built in as a first class citizen. Authentication and authorization enable secure zero trust networking by providing every service an identity and... -
20
ClawRouter
Smart LLM router
ClawRouter is a flexible networking and routing framework designed to support AI-oriented distributed systems and agent ecosystems by managing how messages, requests, and responses are routed between components. It provides a programmable router abstraction that can handle complex traffic patterns, enabling dynamic message forwarding, load balancing, and custom routing logic based on content, context, or policy rules. Because distributed AI systems often involve many services, agents, and runtime components interacting with each other and with external APIs, ClawRouter helps ensure that communication paths remain clear, efficient, and adaptable as systems scale. The framework supports plugin-based extensions so developers can define custom protocols, transformation hooks, and monitoring handlers without modifying core routing logic. ... -
21
frp
A Fast Reverse Proxy
frp stands for exactly what it is: a fast reverse proxy. It helps you expose a local server behind a NAT or firewall to the Internet. It is currently under development, but already supports TCP and UDP, as well as HTTP and HTTPS protocols where requests can be forwarded to internal services by domain name. It also has a P2P connect mode and many other nifty features. These include configuration files, environment variables, a dashboard that shows you frp's status and proxies' statistics... -
22
Envoy
Cloud-native high-performance edge/middle/service proxy
Envoy is an open source, high-performance edge/middle/service proxy designed for cloud-native applications. It was built by Lyft to solve the common problem of networking and observability when moving to a distributed architecture. Envoy is a proxy designed for single services and applications. Aside from that it is also a communication bus and “universal data plane” designed for large microservice “service mesh” architectures. It runs right along with every application, and abstracts the... -
23
DeepSeek-V3
Powerful AI language model (MoE) optimized for efficiency/performance
DeepSeek-V3 is a robust Mixture-of-Experts (MoE) language model developed by DeepSeek, featuring a total of 671 billion parameters, with 37 billion activated per token. It employs Multi-head Latent Attention (MLA) and the DeepSeekMoE architecture to enhance computational efficiency. The model introduces an auxiliary-loss-free load balancing strategy and a multi-token prediction training objective to boost performance. Trained on 14.8 trillion diverse, high-quality tokens, DeepSeek-V3 underwent supervised fine-tuning and reinforcement learning to fully realize its capabilities. Evaluations indicate that it outperforms other open-source models and rivals leading closed-source models, achieving this with a training duration of 55 days on 2,048 Nvidia H800 GPUs, costing approximately $5.58 million. -
24
Sing-box
The universal proxy platform
Sing-box is a universal proxy platform written in Go with support for servers and clients across platforms. It handles multiple proxy protocols with advanced routing, supports TUN-based transparent proxying, and offers both CLI and native graphical clients. -
25
System Design
Learn how to design systems and prepare for system design interviews
...It organizes core networking and distributed-systems concepts into a structured path, so you can build intuition before jumping into “design X” exercises. It covers the building blocks that show up in real architectures, such as DNS, load balancing, caching, CDNs, proxies, scalability and availability tradeoffs, and storage patterns, then connects those pieces to larger system goals. The materials are geared toward clarity and repeatability, making it useful both for self-study and for quick review before interviews. It emphasizes the why behind design decisions, not just a list of components, so you can explain tradeoffs under constraints like cost, latency, reliability, and growth. ...