RouteLLM

RouteLLM

LMSYS
+
+

Related Products

  • Runpod
    230 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • Gemini Enterprise Agent Platform
    999 Ratings
    Visit Website
  • Google AI Studio
    30 Ratings
    Visit Website
  • CredentialStream
    190 Ratings
    Visit Website
  • Cloudflare
    2,035 Ratings
    Visit Website
  • FAMCare Human Services
    25 Ratings
    Visit Website
  • KrakenD
    71 Ratings
    Visit Website
  • Admin By Request Endpoint Privilege Management
    98 Ratings
    Visit Website
  • Chainstack
    34 Ratings
    Visit Website

About

Cheaper Inference is an OpenAI-compatible API gateway that provides access to AI models from multiple providers through a single API key, without requiring users to change their request format. Developers can switch by replacing the provider base URL and API key while keeping the same model, messages, tools, streaming settings, and response handling. It supports text and image models, vision-capable chat requests, streaming, prompt caching, reasoning controls, and temporary image uploads for larger vision payloads. Models are selected per request, and the catalog can be filtered by type, vision, reasoning, streaming, or provider. Automatic retries handle network and provider failures, while eligible fallback routes can be tried before a request fails. Every request is visible in History, giving teams a record of request volume, token usage, and operational activity.

About

Developed by LM-SYS, RouteLLM is an open-source toolkit that allows users to route tasks between different large language models to improve efficiency and manage resources. It supports strategy-based routing, helping developers balance speed, accuracy, and cost by selecting the best model for each input dynamically.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

AI teams and developers in need of a tool to access and route requests across multiple AI models and providers through one OpenAI-compatible API

Audience

AI developers and researchers looking to optimize workflows using multiple LLMs through intelligent routing and performance-aware model selection

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

$0.48 per output
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Keak
United States
cheaperinference.com

Company Information

LMSYS
github.com/lm-sys/RouteLLM

Alternatives

Alternatives

Router

Router

Ramp
Router

Router

Ramp

Categories

Categories

Integrations

Amazon Bedrock
Chatbot Arena
Claude Haiku 4.5
Claude Opus 4.5
Claude Sonnet 4.6
GLM-4.5-Air
GLM-4.7
GLM-5.3
GLM-5.3-Flash
GPT-4
GPT-5.2-Codex
GPT-5.5
GPT-5.5 Pro
GPT-5.6 Terra
Gemini 3.5 Flash
Gemini 3.5 Flash-Lite
Gemini 3.6 Flash
GitHub
Muse Spark 1.2
Ollama

Integrations

Amazon Bedrock
Chatbot Arena
Claude Haiku 4.5
Claude Opus 4.5
Claude Sonnet 4.6
GLM-4.5-Air
GLM-4.7
GLM-5.3
GLM-5.3-Flash
GPT-4
GPT-5.2-Codex
GPT-5.5
GPT-5.5 Pro
GPT-5.6 Terra
Gemini 3.5 Flash
Gemini 3.5 Flash-Lite
Gemini 3.6 Flash
GitHub
Muse Spark 1.2
Ollama
Claim Cheaper Inference and update features and information
Claim Cheaper Inference and update features and information
Claim RouteLLM and update features and information
Claim RouteLLM and update features and information