Open Source Rust LLM Gateways

The world's fastest AI Gateway proxy, written in Rust and optimized for maximum performance. This high-performance API gateway routes requests to various AI providers (OpenAI, GROQ) with streaming support, making it perfect for developers who need reliable and blazing-fast AI API access.

AQBot is a free, open-source AI desktop workspace that combines multi-provider conversations, coding agents, knowledge management, and API gateway functionality. It supports OpenAI, Claude, Gemini, DeepSeek, Qwen, and custom compatible endpoints. Users can compare model responses, branch conversations, and manage reusable AI personas. Its Agent Client Protocol workspace connects external coding agents such as Codex, Claude Agent, and OpenCode. Integrated tools allow agents to edit files, execute commands, and interact with MCP servers under configurable permissions. A local knowledge base supports document retrieval and contextual conversations. The built-in API gateway exposes multiple provider-compatible endpoints for external applications. Available for Windows, macOS, and Linux, AQBot stores application data locally and supports encrypted backups.

AI Gateway is a high-performance, open-source API gateway optimized for managing and monitoring LLM traffic at scale. Developed by the LangDB team, AI Gateway acts as an intermediary between clients and backend LLMs, providing advanced features like caching, rate limiting, prompt management, and observability. It helps teams secure and optimize their LLM deployments, whether using local models or external APIs like OpenAI or Anthropic. With native support for multi-tenant environments and low-latency inference routing, AI Gateway is an essential tool for companies building production-grade generative AI services.