Search Results for "balancer"

Paddler is an open-source LLM infrastructure platform designed to deploy, manage, and scale large language models on private infrastructure. The system acts as a specialized load balancer and serving layer for language models, enabling organizations to run inference workloads without relying on external API providers. It supports running models locally through engines such as llama.cpp while distributing requests across multiple compute nodes to improve performance and reliability. The architecture is designed with privacy and cost control in mind, making it suitable for organizations that handle sensitive data or require predictable operational costs. ...

PgCat is a high-performance PostgreSQL connection pooler and load balancer built for modern, distributed systems. Written in Rust, PgCat is designed to efficiently manage database connections across multiple shards and replicas while supporting features like automatic failover, query-based routing, and observability. It works with both single-node and multi-tenant Postgres setups, making it ideal for cloud-native applications that require scale and reliability.

pgDog is a PostgreSQL proxy and connection management tool built to improve scalability, routing, and operational control for PostgreSQL deployments. It acts as an intelligent intermediary between applications and database servers, enabling load balancing, query routing, and connection pooling in distributed environments. The project is designed with performance and observability in mind, helping teams manage high-traffic database workloads more efficiently. Its architecture supports modern...