RouteLLMLMSYS
|
flo2Data Products LLP
|
|||||
Related Products
|
||||||
About
Developed by LM-SYS, RouteLLM is an open-source toolkit that allows users to route tasks between different large language models to improve efficiency and manage resources. It supports strategy-based routing, helping developers balance speed, accuracy, and cost by selecting the best model for each input dynamically.
|
About
flo2 is an LLM gateway and router that provides access to major AI model providers (OpenAI, Anthropic, Groq, Cerebras, DeepInfra) through one unified, OpenAI-compatible API. Smart routing picks the cheapest or fastest model per request. Automatic fallback keeps applications running when a provider goes down. Racing mode runs requests across providers in parallel. Full cost accounting per request, per model, per project. Developers use their own provider keys via flo2.com — RapidAPI's testing tier includes free tokens for evaluation.
|
|||||
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
Audience
AI developers and researchers looking to optimize workflows using multiple LLMs through intelligent routing and performance-aware model selection
|
Audience
Backend developers and AI engineers who already use LLM APIs in production and pay for them directly.
|
|||||
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
|||||
API
Offers API
Supported
|
API
Offers API
Supported
|
|||||
Screenshots and Videos |
Screenshots and VideosNo images available
|
|||||
Pricing
No information available.
Free Version
Supported
Free Trial
Not Supported
|
Pricing
0
Free Version
Supported
Free Trial
Not Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
Company InformationLMSYS
github.com/lm-sys/RouteLLM
|
Company InformationData Products LLP
Founded: 2026
United Kingdom
flo2.com
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
OpenAI
Supported
Amazon Bedrock
Supported
Anthropic
Not Supported
Anyscale
Supported
Cerebras
Not Supported
Chatbot Arena
Supported
Claude
Supported
GPT-4
Supported
Gemini
Supported
Gemini Enterprise
Supported
|
Integrations
OpenAI
Supported
Amazon Bedrock
Not Supported
Anthropic
Supported
Anyscale
Not Supported
Cerebras
Supported
Chatbot Arena
Not Supported
Claude
Not Supported
GPT-4
Not Supported
Gemini
Not Supported
Gemini Enterprise
Not Supported
|
|||||
|
|
|