Microsoft’s MCP Gateway is a reverse proxy and management layer for MCP servers that adds session-aware routing, lifecycle management, and scalable orchestration. It centralizes how clients connect to many MCP services, enabling multi-tenant isolation and consistent policies while keeping each service independently deployable. The architecture targets Kubernetes, with manifests and guidance for cluster-native scaling, health probes, and rollout strategies. It also includes local and Azure deployment recipes, making it straightforward to try on a laptop and then promote to cloud infrastructure. Core concepts—like session routing, server pools, and pluggable policies—are documented to help teams reason about stateful agent sessions at scale. By standardizing discovery and control, it reduces operational toil and improves reliability for agent platforms built on MCP.
Features
- Reverse proxy for many MCP servers with session-aware routing
- Lifecycle management for server pools and instances
- Kubernetes-first deployment with scaling and health checks
- Local and Azure getting-started paths
- Policy hooks for access control and governance
- Centralized discovery to simplify multi-service topologies