Switchyard is a Rust proxy and library for routing traffic between LLM clients and model backends. It translates among OpenAI Chat, OpenAI Responses, and Anthropic Messages formats so agents can keep using their native APIs. Requests can be distributed across vLLM, NVIDIA NIM, Ollama, OpenRouter, and other compatible endpoints. Routing strategies include random splits, LLM classification, signal-driven stage routing, escalation, and custom algorithms. Prometheus metrics track requests, errors, latency, tokens, and routing overhead. Developers can run it as a standalone server, launch coding agents through it, or embed its routing logic in Rust applications. The project is currently pre-alpha and explicitly marked experimental rather than production-ready.

Features

  • OpenAI and Anthropic protocol translation
  • Multi-backend LLM traffic routing
  • Random, classifier, stage, and escalation routing
  • Prometheus operational metrics
  • Standalone server and agent launcher
  • Embeddable Rust routing library

Project Samples

Switchyard Screenshot 1

Project Activity

See All Activity >

Categories

Artificial Intelligence

License

Apache License V2.0

Follow Switchyard

Switchyard Web Site

Other Useful Business Software
$300 Free Credits to Build on Google Cloud Icon
$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Switchyard!

Additional Project Details

Programming Language

Rust

Related Categories

Rust Artificial Intelligence Software

Registered

2026-08-13
Report inappropriate content