Switchyard is a Rust proxy and library for routing traffic between LLM clients and model backends. It translates among OpenAI Chat, OpenAI Responses, and Anthropic Messages formats so agents can keep using their native APIs. Requests can be distributed across vLLM, NVIDIA NIM, Ollama, OpenRouter, and other compatible endpoints. Routing strategies include random splits, LLM classification, signal-driven stage routing, escalation, and custom algorithms. Prometheus metrics track requests, errors, latency, tokens, and routing overhead. Developers can run it as a standalone server, launch coding agents through it, or embed its routing logic in Rust applications. The project is currently pre-alpha and explicitly marked experimental rather than production-ready.

Features

  • OpenAI and Anthropic protocol translation
  • Multi-backend LLM traffic routing
  • Random, classifier, stage, and escalation routing
  • Prometheus operational metrics
  • Standalone server and agent launcher
  • Embeddable Rust routing library

Project Samples

Switchyard Screenshot 1

Project Activity

See All Activity >

Categories

Artificial Intelligence

License

Apache License V2.0

Follow Switchyard

Switchyard Web Site

Other Useful Business Software
MongoDB Atlas runs apps anywhere Icon
MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Switchyard!

Additional Project Details

Programming Language

Rust

Related Categories

Rust Artificial Intelligence Software

Registered

2026-08-13
Report inappropriate content