Search Results for "load balancing"
Sort By:
Showing 249 open source projects for "load balancing"
View related business solutions-
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
EPLB
Expert Parallelism Load Balancer
...It uses policies like hierarchical load balancing (grouped experts placed at node and then GPU level) and global load balancing depending on configuration. The logic is implemented in eplb.py and supports predicting placements given estimated expert usage weights. EPLB aims to reduce hot-spotting and ensure more uniform usage of compute resources in large MoE deployments. -
2
GoProxy
High performance proxy server implemented by golang
The GoProxy is a high-performance http proxy, https proxy, socks5 proxy, ss proxy, websocket proxies, tcp proxies, udp proxies, game shield, game proxies. Supports forward proxies, reverse proxy, transparent proxy, internet nat proxies, https proxy load balancing, http proxy load balancing , socks5 proxies load balancing, socket proxy load balancing, ss proxy load balancing, TCP / UDP port mapping, SSH transit, TLS encrypted transmission, protocol conversion, anti-pollution DNS proxy, API authentication, speed limit, limit connection. Reverse proxy to help you expose a local server behind a NAT or firewall to the internet so that you or your visitors can access it directly and easily. ... -
3
Seesaw v2
Seesaw v2 is a Linux Virtual Server based load balancing platform
Seesaw is a software load balancer and traffic director focused on L3/L4 load balancing with high availability and operational simplicity. Built with production reliability in mind, it uses anycast and health-checking to steer traffic to healthy backends while avoiding single points of failure. It supports common load-balancing policies, NAT, and VIP management, and pairs with standard Linux networking primitives for predictable performance. ... -
4
PgDog
PostgreSQL connection pooler, load balancer and database sharder
...In practice, the tool helps organizations scale PostgreSQL clusters while maintaining reliability and predictable performance under load. -
Paessler: Easy to Use With Enterprise Power. Free TrialYou shouldn't have to choose between a monitoring tool that's easy to use and one that's powerful enough for a complex environment. PRTG's low-code interface lets any admin build dashboards, set alerts and monitor devices without scripting, while custom sensors and full API access are there when your team needs deeper control. One platform, no compromise. Download a free 30-day trial now.
-
5
Eureka
AWS Service registry for resilient mid-tier load balancing
Eureka is a REST (Representational State Transfer) based service that is primarily used in the AWS cloud for locating services for the purpose of load balancing and failover of middle-tier servers. t Netflix, Eureka is used for the following purposes apart from playing a critical part in mid-tier load balancing. For aiding Netflix Asgard, an open source service which makes cloud deployments easier, in fast rollback of versions in case of problems avoiding the re-launch of 100's of instances which could take a long time. ... -
6
BFE
A modern layer 7 load balancer from baidu
...Future support is planned for HTTP/3. BFE provides an advanced domain-specific language to describe routing rules which are easy to understand and maintain. BFE supports global load balancing and distributed load balancing for zone aware balancing, zone level failure resilience, overload protection etc. BFE provides a rich set of plugins for traffic management, security, observability, etc. BFE includes detailed built-in metrics for all subsystems. BFE writes various logs for trouble shooting, data analysis and visualization. ... -
7
Apache Dubbo
A high performance Java RPC framework
Apache Dubbo is a high performance, lightweight, open source RPC framework written in Java. It offers three key functionalities: interface based remote call, load balancing and fault tolerance, and automatic service registration and discovery. Apache Dubbo is built to support multiple service registries and load balancing strategies right out of the box. Due to its micro-kernel and plugin design it can also be easily extended through third-party implementations. Plenty of companies are using Dubbo, and are helping to continually improve it through Dubbo’s improvement initiative, “Wanted: who’s using dubbo”. -
8
ClickHouse Go
Golang driver for ClickHouse
...Database/sql supports http protocol for transport. (Experimental). Marshal rows into structs (ScanStruct, Select). Unmarshal struct to row (AppendStruct). Connection pool Failover and load balancing. Bulk write support (for database/sql use begin->prepare->(in loop exec)->commit). AsyncInsert, named and numeric placeholders support. LZ4/ZSTD compression support. External data. -
9
pgcat
PostgreSQL pooler with sharding, load balancing and failover support
PgCat is a high-performance PostgreSQL connection pooler and load balancer built for modern, distributed systems. Written in Rust, PgCat is designed to efficiently manage database connections across multiple shards and replicas while supporting features like automatic failover, query-based routing, and observability. It works with both single-node and multi-tenant Postgres setups, making it ideal for cloud-native applications that require scale and reliability. -
Earn up to 16% annual interest with Nexo.Put idle assets to work with competitive interest rates, borrow without selling, and trade with precision. All in one platform. Geographic restrictions, eligibility, and terms apply.
-
10
RtspSimpleServer
ready-to-use RTSP / RTMP / LL-HLS / WebRTC server and proxy
...For instance, it's possible to publish a stream with RTSP and read it with HLS. Serve multiple streams at once in separate paths Authenticate users; use internal or external authentication. Redirect readers to other RTSP servers (load balancing) Query and control the server through an HTTP API. Reload the configuration without disconnecting existing clients (hot reloading) Read Prometheus-compatible metrics. Run external commands when clients connect, disconnect, read or publish streams. Natively compatible with the Raspberry Pi Camera. Compatible with Linux, Windows and macOS, does not require any dependency or interpreter. -
11
MsQuic
Cross-platform, C implementation of the IETF QUIC protocol
...Exchange application data in the first round trip (0-RTT). Improved congestion control and loss recovery. Survives a change in the clients IP address or port. Stateless load balancing. -
12
Cilium
eBPF-based networking, security, and observability
Cilium is open-source software for providing, securing and observing network connectivity between container workloads, cloud-native, and fueled by the revolutionary Kernel technology eBPF. Kubernetes doesn't come with an implementation of Load Balancing. This is usually left as an exercise for your cloud provider or in private cloud environments an exercise for your networking team. Cilium can attract this traffic with BGP and accelerate leveraging XDP and eBPF. Together these technologies provide a very robust and secure implementation of Load Balancing. Cilium and eBPF operate at the kernel layer. ... -
13
Sub2API
Sub2API-CRS2 is a one-stop open source transit service
...It allows users to create platform-issued API keys while routing requests to upstream AI services behind the scenes. The platform handles authentication, quota allocation, billing logic, load balancing, and request forwarding, making it useful for shared or team-based access management. It is designed to unify access to services such as Claude, OpenAI, Gemini, and related AI tools through a centralized relay layer. Sub2API supports deployment through Docker Compose or binary installation for Linux servers. Its main value is turning multiple subscription-based AI accounts into a managed API access platform with administrative controls. -
14
Quartz.NET
Quartz enterprise scheduler .NET
...Built-in support for load balancing your work and graceful fail-over. Applications can catch scheduling events to monitor or control job/trigger behavior by implementing one or more listener interfaces. -
15
Npgsql
Npgsql is the .NET data provider for PostgreSQL
Npgsql is an open source ADO.NET Data Provider for PostgreSQL, it allows programs written in C#, Visual Basic, F# to access the PostgreSQL database server. It is implemented in 100% C# code, is free and is open source. An Entity Framework Core provider is also available and exposes some features unique to the PostgreSQL database to EF Core users. Finally, a legacy Entity Framework 6.x (non-Core) provider is also available but is no longer being actively maintained. Npgsql is the open source... -
16
CoreDNS
CoreDNS is a DNS server that chains plugins
...Serve zone data from a file; both DNSSEC (NSEC only) and DNS are supported (file and auto). Retrieve zone data from primaries, i.e., act as a secondary server (AXFR only) (secondary). Sign zone data on-the-fly (dnssec). Load balancing of responses (loadbalance). Allow for zone transfers, i.e., act as a primary server (file + transfer). Automatically load zone files from disk (auto). -
17
AxonHub
Use any SDK to call 100+ LLMs
...AxonHub translates requests from one provider’s API format into another, enabling seamless interoperability across different AI platforms. The system also provides infrastructure features such as request routing, failover mechanisms, load balancing, and cost management for AI applications. This architecture makes it easier to experiment with multiple models and manage production deployments that rely on several providers simultaneously. -
18
7 days golang programs from scratch
7 days golang programs from scratch (web framework Gee
...GeeCache demonstrates LRU caching, concurrency, consistent hashing, distributed nodes, single-flight protection, and Protobuf communication. GeeORM covers mapping, queries, hooks, transactions, and migrations. GeeRPC builds on net/rpc with concurrent clients, timeouts, HTTP transport, load balancing, registration, and service discovery. -
19
Kong
The Cloud-Native API Gateway
...When building for the web, mobile, or Internet of Things, you’ll need a common functionality to run your software, and Kong is that solution. Kong acts as a gateway, connecting microservices requests and APIs natively while also providing load balancing, logging, monitoring, authentication, rate-limiting, and so much more through plugins. Kong is highly extensible as well as platform agnostic, connecting APIs across different environments, platforms and patterns. Achieve architectural freedom with Kong today. -
20
WeChat-AI
Self-hosted WeChat role-playing conversation service
...Administrators receive dashboards for users, bots, token usage, deployment nodes, and sticker moderation. The platform supports visual Chatflow orchestration, multi-node deployment with shared Redis, Cloudflare load balancing, and incremental OTA updates. -
21
Xray Core
Xray, Penetrates Everything. Also the best v2ray-core
Xray-core is an enhanced superset of v2ray-core, providing a high-performance privacy proxy framework supporting XTLS. It offers full compatibility with v2ray configs, supports multiple protocols, advanced routing, and is distributed as a single executable. -
22
Sing-box
The universal proxy platform
Sing-box is a universal proxy platform written in Go with support for servers and clients across platforms. It handles multiple proxy protocols with advanced routing, supports TUN-based transparent proxying, and offers both CLI and native graphical clients. -
23
DeepSeek-V3
Powerful AI language model (MoE) optimized for efficiency/performance
DeepSeek-V3 is a robust Mixture-of-Experts (MoE) language model developed by DeepSeek, featuring a total of 671 billion parameters, with 37 billion activated per token. It employs Multi-head Latent Attention (MLA) and the DeepSeekMoE architecture to enhance computational efficiency. The model introduces an auxiliary-loss-free load balancing strategy and a multi-token prediction training objective to boost performance. Trained on 14.8 trillion diverse, high-quality tokens, DeepSeek-V3 underwent supervised fine-tuning and reinforcement learning to fully realize its capabilities. Evaluations indicate that it outperforms other open-source models and rivals leading closed-source models, achieving this with a training duration of 55 days on 2,048 Nvidia H800 GPUs, costing approximately $5.58 million. -
24
Paddler
Open-source LLM load balancer and serving platform for hosting LLMs
Paddler is an open-source LLM infrastructure platform designed to deploy, manage, and scale large language models on private infrastructure. The system acts as a specialized load balancer and serving layer for language models, enabling organizations to run inference workloads without relying on external API providers. It supports running models locally through engines such as llama.cpp while distributing requests across multiple compute nodes to improve performance and reliability. The... -
25
LoLLMs Hub Fortress
A proxy server for multiple ollama instances with Key security
...This design allows organizations to scale horizontally, combining local hardware, cloud resources, and specialized inference servers into a unified infrastructure. LoLLMs Hub also introduces intelligent routing mechanisms that automatically select the most appropriate model based on rules such as priority, load balancing, or availability, improving efficiency and reliability.
