agentgateway Files

Agentgateway is an open source project that is built on AI-native protocols to connect, secure, and observe agent-to-agent and agent-to-tool communication across any agent framework and environment.

This release is one of the largest Agentgateway releases to date, and includes significant new features and improvements.

New Features

• Added support for Mutual TLS listeners
• LLM Prompt Guards now support multiple prompt guards, in an ordered list
• Added support for automatic LLM Prompt Caching
• Added support for LLM Embeddings
• Added support for OpenAI Responses API
• Added support for Anthropic Count Tokens API
• Added support for Basic authentication
• Added support for API Key authentication
• Support for stateful routing to MCP backends
• Added support for HTTP-based External Authorization servers (in addition to the existing gRPC support). Check out the examples using this to integrate with Tailscale and Oauth2 Proxy!
• CIDR and IP support for CEL expressions. See the example for a sample IP authorization allowlist!
• Added support for the Azure OpenAI provider
• Policies can now be specified on listeners, allowing policies to run before routing occurs.
• A new concept of "Frontend Policies" has been added. These can be configured at the top level frontendPolicies field. Frontend policies define how to handle incoming traffic, and can be dynamically updated. This includes fields to customize TCP, TLS, and HTTP behavior, as well as logging and tracing.
• New fields have been exposed to CEL expressions: response.headers, apiKey, basicAuth, llm.params.{dimensions,encoding_format} (for Embeddings), and source.{subjectAltNames,issuer,subject,subjectCn} (for Mutual TLS).

Kubernetes Controller (Kgateway)

When deploying Agentgateway, it is recommended to run with Kgateway which provides a first class Kubernetes controller (with Gateway API support). In addition to the features above, this release paves the way for the upcoming Kgateway v2.2.0, which is a major leap forward in running Agentgateway on Kubernetes.

This release will further decoupled Agentgateway from Kgateway's Envoy-based components, including...

• A new set of APIs: AgentgatewayPolicy, AgentgatewayBackend, and AgentgatewayParameters.
• A new Helm chart for Agentgateway usage.
• A new controller image dedicated to Agentgateway.

These new changes will avoid confusion between the two dataplane modes of Kgateway, and enhance our ability to deliver features quickly.

Please note, these changes represent a breaking change in the v2.1.0 to v2.2.0 upgrade. Please consult the migration guide, and stay tuned for the official v2.2.0 release!

Breaking Changes

• When using the promptGuard policy type, guards (regex, webhook, moderation, etc) are now specified in an ordered list.
• When using the extAuthz policy type, a new field protocol is required. To retain the old behavior, set this to grpc.
• When using an ai backend type, the following fields have been moved: backendAuth, backendTLS, promptGuard, prompts, overrides, defaults, modelAliases. Instead, these are now under policies.backendAuth, and similar for the others. In addition, all backend policies may now be set on the new field, instead of just the subset that was previously allowed.
• The config.listener settings have been moved to frontendPolicies.

What's Changed

• cleanup: remove unused funcs by @jenshu in https://github.com/agentgateway/agentgateway/pull/592
• Implement new Xds API by @howardjohn in https://github.com/agentgateway/agentgateway/pull/588
• chore: remove deprecated github.com/golang/protobuf by @Juneezee in https://github.com/agentgateway/agentgateway/pull/600
• Ensure JWT claims are available to route‑level CEL expressions by @webcodes-cz in https://github.com/agentgateway/agentgateway/pull/599
• Fix inline backend policies ("filters") by @howardjohn in https://github.com/agentgateway/agentgateway/pull/604
• feat: Support optional JWT audience validation by @heojay in https://github.com/agentgateway/agentgateway/pull/606
• Add Basic Authentication and API Key authentication by @howardjohn in https://github.com/agentgateway/agentgateway/pull/605
• backends: support inline policies by @howardjohn in https://github.com/agentgateway/agentgateway/pull/610
• proto: support multiple jwt providers by @howardjohn in https://github.com/agentgateway/agentgateway/pull/611
• fix stack overflow with large OpenAPI by @howardjohn in https://github.com/agentgateway/agentgateway/pull/612
• ext authz: allow sending metadata like JWT by @howardjohn in https://github.com/agentgateway/agentgateway/pull/613
• ui: AI backend fixes by @jenshu in https://github.com/agentgateway/agentgateway/pull/607
• Automatically rewrite hostname by @howardjohn in https://github.com/agentgateway/agentgateway/pull/522
• Fix accidental log line by @howardjohn in https://github.com/agentgateway/agentgateway/pull/615
• JWT unit tests by @puertomontt in https://github.com/agentgateway/agentgateway/pull/581
• local config: give useful errors on AI issues by @howardjohn in https://github.com/agentgateway/agentgateway/pull/616
• Azure OpenAI support by @jenshu in https://github.com/agentgateway/agentgateway/pull/589
• Add security policy by @howardjohn in https://github.com/agentgateway/agentgateway/pull/624
• perf: do not generate an unused error on the dns hotpath by @howardjohn in https://github.com/agentgateway/agentgateway/pull/622
• refactored backend forms to use full URLs for MCP and SSE targets, re… by @peterj in https://github.com/agentgateway/agentgateway/pull/561
• feat: responses api and bedrock features by @apexlnc in https://github.com/agentgateway/agentgateway/pull/603
• Bump deps by @howardjohn in https://github.com/agentgateway/agentgateway/pull/623
• support for Anthropic models with Vertex by @puertomontt in https://github.com/agentgateway/agentgateway/pull/643
• Support pseudo headers in HTTP route matching by @Copilot in https://github.com/agentgateway/agentgateway/pull/626
• Add support for double-hbone by @ymesika in https://github.com/agentgateway/agentgateway/pull/591
• feat: enable route and gateway targeting for backend policies by @apexlnc in https://github.com/agentgateway/agentgateway/pull/629
• add 'timeout' to 'extAuthz' config for local input by @stoicflame in https://github.com/agentgateway/agentgateway/pull/644
• Fix regression in local config mcp with tls by @howardjohn in https://github.com/agentgateway/agentgateway/pull/645
• tracing: fix regression dropping attributes by @howardjohn in https://github.com/agentgateway/agentgateway/pull/646
• http: add better version override/detection by @howardjohn in https://github.com/agentgateway/agentgateway/pull/617
• local config: refactor to avoid needing to duplicate objects by @howardjohn in https://github.com/agentgateway/agentgateway/pull/653
• Implement changes for AgentgatewayBackend by @howardjohn in https://github.com/agentgateway/agentgateway/pull/654
• Add json marshalling support to go types by @howardjohn in https://github.com/agentgateway/agentgateway/pull/656
• Flesh out more of backend policy by @howardjohn in https://github.com/agentgateway/agentgateway/pull/657
• cel: accept invalid expressions and make them fail by @howardjohn in https://github.com/agentgateway/agentgateway/pull/660
• xds: accept invalid server TLS and reject at runtime by @howardjohn in https://github.com/agentgateway/agentgateway/pull/661
• Stateful MCP routing for service backends by @msavin99 in https://github.com/agentgateway/agentgateway/pull/609
• mcp/openapi: handle compressed responses in tool calls by @chunkygupta in https://github.com/agentgateway/agentgateway/pull/655
• feat: Support MCP Authn when configured by xDS by @jmcguire98 in https://github.com/agentgateway/agentgateway/pull/637
• Address double-hbone post-merge review comments by @ymesika in https://github.com/agentgateway/agentgateway/pull/649
• ext_authz: Add append_action support to HeaderValueOption by @Copilot in https://github.com/agentgateway/agentgateway/pull/664
• fix: Bedrock count_tokens response handling by @apexlnc in https://github.com/agentgateway/agentgateway/pull/628
• Fix remote ratelimit header values by @msavin99 in https://github.com/agentgateway/agentgateway/pull/668
• feat: add wildcard pattern matching for model aliases by @apexlnc in https://github.com/agentgateway/agentgateway/pull/630
• fix: CEL executor for transformations to include extAuthz metadata by @apexlnc in https://github.com/agentgateway/agentgateway/pull/665
• refactor: move routes from AI provider to backend policy by @apexlnc in https://github.com/agentgateway/agentgateway/pull/669
• cel: support CIDR and IP functions by @howardjohn in https://github.com/agentgateway/agentgateway/pull/671
• Cross-compile Docker images on amd64 by @yuval-k in https://github.com/agentgateway/agentgateway/pull/658
• cel: rewrite flatten to use opaque instead of sentinal value by @howardjohn in https://github.com/agentgateway/agentgateway/pull/676
• Expose client cert auth and more attributes on TLS listeners by @howardjohn in https://github.com/agentgateway/agentgateway/pull/666
• Add structured test cases and phase-specific benchmarks for CEL module by @Copilot in https://github.com/agentgateway/agentgateway/pull/647
• cel: reduce builds of the context when not needed by @howardjohn in https://github.com/agentgateway/agentgateway/pull/679
• Fix MCP StreamableHTTP parsing errors for empty data fields by @msavin99 in https://github.com/agentgateway/agentgateway/pull/681
• clear disk space for release by @yuval-k in https://github.com/agentgateway/agentgateway/pull/685
• openapi: fix double required body by @howardjohn in https://github.com/agentgateway/agentgateway/pull/686
• xds: fix DFP by @howardjohn in https://github.com/agentgateway/agentgateway/pull/687
• metrics: fix negotiation by @howardjohn in https://github.com/agentgateway/agentgateway/pull/689
• proto: rework attachments to avoid magic strings by @howardjohn in https://github.com/agentgateway/agentgateway/pull/690
• cel: document toJson function by @howardjohn in https://github.com/agentgateway/agentgateway/pull/693
• proto: avoid magic strings in backend references by @howardjohn in https://github.com/agentgateway/agentgateway/pull/694
• Update readme by @artberger in https://github.com/agentgateway/agentgateway/pull/698
• docs: use modern CEL function names by @howardjohn in https://github.com/agentgateway/agentgateway/pull/699
• Add support for HTTP ext_authz, with oauth2_proxy example by @howardjohn in https://github.com/agentgateway/agentgateway/pull/696
• Fixed npm audit issues by @Charlesthebird in https://github.com/agentgateway/agentgateway/pull/710
• llm: refactor module structure by @howardjohn in https://github.com/agentgateway/agentgateway/pull/713
• default region for aws backends by @yuval-k in https://github.com/agentgateway/agentgateway/pull/718
• feat(cel): uuid added to cel by @gurneyds2 in https://github.com/agentgateway/agentgateway/pull/709
• fix backend policies with local MCP config by @howardjohn in https://github.com/agentgateway/agentgateway/pull/717
• Fix npm audit issue by @Charlesthebird in https://github.com/agentgateway/agentgateway/pull/722
• Fix session cleanup for stateless MCP mode by @derekjfrei in https://github.com/agentgateway/agentgateway/pull/719
• llm: add support for embeddings by @howardjohn in https://github.com/agentgateway/agentgateway/pull/716
• MCP Authn unset provider and jwt modes by @npolshakova in https://github.com/agentgateway/agentgateway/pull/695
• llm: consistent req and resp guardrail syntax by @howardjohn in https://github.com/agentgateway/agentgateway/pull/733
• proto: add Protocol to bind by @howardjohn in https://github.com/agentgateway/agentgateway/pull/732
• fix(mcp): handle compressed responses in StreamableHTTP transport by @apexlnc in https://github.com/agentgateway/agentgateway/pull/730
• feat(llm): add Embeddings route type for /v1/embeddings by @tt-a1i in https://github.com/agentgateway/agentgateway/pull/728
• Bind: add new tunnel protocol concept by @howardjohn in https://github.com/agentgateway/agentgateway/pull/735
• implement backend timeout by @howardjohn in https://github.com/agentgateway/agentgateway/pull/736
• feat: add PROXY protocol v2 support by @apexlnc in https://github.com/agentgateway/agentgateway/pull/729
• ext authz: allow 'including' pseudo header by @howardjohn in https://github.com/agentgateway/agentgateway/pull/739
• cleanup: backend auth by @yuval-k in https://github.com/agentgateway/agentgateway/pull/738
• mcp: negotiate protocol version by @howardjohn in https://github.com/agentgateway/agentgateway/pull/740
• Add support for Canadian Social Insurance Number prompt guards by @kevin-shelaga in https://github.com/agentgateway/agentgateway/pull/737
• docs: cleanup formatting of autogenerated schemas by @howardjohn in https://github.com/agentgateway/agentgateway/pull/741
• Guardrail Metrics by @npolshakova in https://github.com/agentgateway/agentgateway/pull/697
• schema: add deprecation notices by @howardjohn in https://github.com/agentgateway/agentgateway/pull/746
• wip: use Istio WDS instead of our own by @howardjohn in https://github.com/agentgateway/agentgateway/pull/743
• mcp: fix backend policies by @howardjohn in https://github.com/agentgateway/agentgateway/pull/748
• Disable write access for xds, display policies in ui by @npolshakova in https://github.com/agentgateway/agentgateway/pull/744
• cel: add context from gateway policies for apikey/basic auth by @howardjohn in https://github.com/agentgateway/agentgateway/pull/750

New Contributors

• @jenshu made their first contribution in https://github.com/agentgateway/agentgateway/pull/592
• @Juneezee made their first contribution in https://github.com/agentgateway/agentgateway/pull/600
• @webcodes-cz made their first contribution in https://github.com/agentgateway/agentgateway/pull/599
• @puertomontt made their first contribution in https://github.com/agentgateway/agentgateway/pull/581
• @Copilot made their first contribution in https://github.com/agentgateway/agentgateway/pull/626
• @ymesika made their first contribution in https://github.com/agentgateway/agentgateway/pull/591
• @stoicflame made their first contribution in https://github.com/agentgateway/agentgateway/pull/644
• @msavin99 made their first contribution in https://github.com/agentgateway/agentgateway/pull/609
• @chunkygupta made their first contribution in https://github.com/agentgateway/agentgateway/pull/655
• @artberger made their first contribution in https://github.com/agentgateway/agentgateway/pull/698
• @Charlesthebird made their first contribution in https://github.com/agentgateway/agentgateway/pull/710
• @gurneyds2 made their first contribution in https://github.com/agentgateway/agentgateway/pull/709
• @derekjfrei made their first contribution in https://github.com/agentgateway/agentgateway/pull/719
• @tt-a1i made their first contribution in https://github.com/agentgateway/agentgateway/pull/728
• @kevin-shelaga made their first contribution in https://github.com/agentgateway/agentgateway/pull/737

Full Changelog: https://github.com/agentgateway/agentgateway/compare/v0.10.5...v0.11.0