LLM Gateway
LLM Gateway is a fully open source, unified API gateway that lets you route, manage, and analyze requests to any large language model provider, OpenAI, Anthropic, Gemini Enterprise Agent Platform, and more, using a single, OpenAI-compatible endpoint. It offers multi-provider support with seamless migration and integration, dynamic model orchestration that routes each request to the optimal engine, and comprehensive usage analytics to track requests, token consumption, response times, and costs in real time. Built-in performance monitoring lets you compare models’ accuracy and cost-effectiveness, while secure key management centralizes API credentials under role-based controls. You can deploy LLM Gateway on your own infrastructure under the MIT license or use the hosted service as a progressive web app, and simple integration means you only need to change your API base URL, your existing code in any language or framework (cURL, Python, TypeScript, Go, etc.)
Learn more
Crazyrouter
Crazyrouter is an AI API gateway that gives developers access to 300+ AI models through a single API key. Compatible with the OpenAI SDK format, it supports GPT-5, Claude, Gemini, DeepSeek, Llama, Mistral, and hundreds more — all at prices up to 50% lower than going direct to providers
Key Features:
• One API key for 300+ models (OpenAI, Anthropic, Google, Meta, etc.)
• OpenAI-compatible API format — zero code changes to switch
• Pay-as-you-go pricing with no monthly subscriptions
• Built-in load balancing, failover, and rate limit management
• Real-time usage dashboard and token tracking
• Support for text, image, video, audio, and embedding models
• Enterprise-grade uptime with multi-region infrastructure
Ideal for developers, startups, and teams who want to experiment with multiple AI models without managing separate API keys and billing accounts.
Learn more
OrcaRouter
OrcaRouter is an OpenAI-compatible AI model router that sends each prompt to the right model across OpenAI, Anthropic, Gemini, DeepSeek, Qwen, Kimi, and 200+ frontier and open source models. It is built to preserve frontier answer quality while reducing AI inference spend by grading every prompt and routing hard reasoning to frontier models and routine work to lower-cost open-source models. The routing is quality-graded, never a blind, cheap-model swap, and each request shows the difficulty grade, selected model, provider, and cost so routes are visible, auditable, and reproducible. Developers can switch by changing the API base URL, while existing SDKs, model names, and streaming behavior continue to work as before. OrcaRouter supports automatic failover, so if a provider goes down mid-stream, traffic can switch transparently, and the application avoids user-facing errors. It also includes API key management with spend caps, model allowlists, rate limits, budget enforcement, and more.
Learn more
OpenCompress
OpenCompress is an open source AI optimization layer designed to reduce the cost, latency, and token usage of large language model interactions by compressing both input prompts and generated outputs without significantly affecting quality. It works as a drop-in middleware that sits in front of any LLM provider, allowing developers to use models like GPT, Claude, Gemini, and others while automatically optimizing every request behind the scenes. It focuses on reducing token waste through a multi-stage pipeline that includes techniques such as code minification, dictionary aliasing, and structured compression of repeated content, enabling more efficient use of context windows and lowering computational overhead. It is model-agnostic and integrates seamlessly with any provider that supports an OpenAI-compatible API, meaning developers can adopt it without changing their existing workflows or infrastructure.
Learn more
