RouteLLM

RouteLLM

LMSYS
+
+

Related Products

  • Anaconda
    625 Ratings
    Visit Website
  • MediRoutes
    442 Ratings
    Visit Website
  • Intulse
    140 Ratings
    Visit Website
  • RouteGenie
    49 Ratings
    Visit Website
  • LendingPad
    302 Ratings
    Visit Website
  • DOP Software
    4 Ratings
    Visit Website
  • Descartes Fleet Performance Management
    40 Ratings
    Visit Website
  • ActCAD Software
    403 Ratings
    Visit Website
  • FinOpsly
    3 Ratings
    Visit Website
  • Redlist
    64 Ratings
    Visit Website

About

Developed by LM-SYS, RouteLLM is an open-source toolkit that allows users to route tasks between different large language models to improve efficiency and manage resources. It supports strategy-based routing, helping developers balance speed, accuracy, and cost by selecting the best model for each input dynamically.

About

TrueFoundry is a unified platform with an enterprise-grade AI Gateway - combining LLM, MCP, and Agent Gateway - to securely manage, route, and govern AI workloads across providers. Its agentic deployment platform also enables GPU-based LLM deployment along with agent deployment with best practices for scalability and efficiency. It supports on-premise and VPC installations while maintaining full compliance with SOC 2, HIPAA, and ITAR standards.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

AI developers and researchers looking to optimize workflows using multiple LLMs through intelligent routing and performance-aware model selection

Audience

Data scientists and ML engineers seeking a solution to manage their endpoint models

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

API

Offers API Supported

API

Offers API Supported

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version Supported
Free Trial Not Supported

Pricing

$5 per month
Free Version Not Supported
Free Trial Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Supported
In Person Supported

Company Information

LMSYS
github.com/lm-sys/RouteLLM

Company Information

TrueFoundry
Founded: 2021
United States
www.truefoundry.com

Alternatives

Alternatives

Experiential

Experiential

Experiential Labs

Categories

AI Gateways Supported
LLM Routers Supported

Categories

Agentic DevOps Supported
AI Gateways Supported
Data Pipeline Supported
Data Science Supported
LLM Routers Supported
Machine Learning Supported
MCP Gateways Supported

Integrations

GitHub Supported
Amazon Bedrock Supported
Bitbucket Not Supported
Claude Supported
Claude Duet Supported
DeepKeep Not Supported
Gemini Supported
Gemini Enterprise Supported
Google Cloud Platform Not Supported
Grafana Cloud Not Supported
Hugging Face Not Supported
MLflow Not Supported
Microsoft Azure Not Supported
Mixtral 8x7B Supported
Model Context Protocol (MCP) Not Supported
Ollama Supported
OpenAI Supported
PyTorch Not Supported
Slack Not Supported
TensorFlow Not Supported

Integrations

GitHub Supported
Amazon Bedrock Not Supported
Bitbucket Supported
Claude Not Supported
Claude Duet Not Supported
DeepKeep Supported
Gemini Not Supported
Gemini Enterprise Not Supported
Google Cloud Platform Supported
Grafana Cloud Supported
Hugging Face Supported
MLflow Supported
Microsoft Azure Supported
Mixtral 8x7B Not Supported
Model Context Protocol (MCP) Supported
Ollama Not Supported
OpenAI Not Supported
PyTorch Supported
Slack Supported
TensorFlow Supported
Claim RouteLLM and update features and information
Claim RouteLLM and update features and information
Claim TrueFoundry and update features and information
Claim TrueFoundry and update features and information