Suna Files

LLM Gateway

• Rebuilt on the Vercel AI SDK + live models.dev. The gateway now runs a single AI-SDK transport for every provider (OpenAI, Anthropic, Bedrock, OpenRouter and more), with the model catalog served verbatim from models.dev. The old per-provider transports and the LiteLLM sidecar have been removed.
• Per-model generation controls. Set reasoning effort, temperature, top_p, and max output tokens per model — each control only appears when the model actually supports it (driven by the live catalog), and applies to every client (chat, SDK, and direct API).
• Reasoning-effort selector in the chat composer for models that expose it (including a thinking-effort control for Claude models).
• Two drop-in API surfaces: OpenAI-compatible /v1/chat/completions and Anthropic-compatible /v1/messages, plus /v1/models — all now documented in the API reference.
• Provider & model manager overhaul: connect providers (incl. Bedrock via bearer token), browse models with pricing, context windows, and capabilities, verify that a key actually works, and see everything grouped under its real provider.
• Anthropic extended thinking and prompt caching are applied correctly, and cost/usage are recorded accurately per request.
• A gen_ai.* OpenTelemetry span is emitted per gateway call for downstream observability.

Templates

• Many new business use-case templates across finance, sales, customer support, marketing, data, and recruiting — each with its own cover art.

Fixes & hardening

• Sandbox proxy no longer times out healthy long reasoning/tool turns.
• Blank projects can start sessions immediately (no more "agent not declared").
• Project-scoped API tokens can drive their own project's sessions.
• Per-project agent model pins no longer collide across projects.
• Faster session/gateway paths and clearer errors on upstream failures.
• Security & compliance: GuardDuty runtime monitoring, IAM baseline, root-login and patch/detection alerting, and corrected SSO/SCIM setup guides.

What's Changed

• chore(release): VERSION → 0.10.11 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4890
• feat(iam-web): 4 more SAML providers + change-provider confirmation by @Ino-Bagaric in https://github.com/kortix-ai/suna/pull/4892
• feat(iam-web): OneLogin, JumpCloud, PingOne Directory Sync (SCIM) guides by @Ino-Bagaric in https://github.com/kortix-ai/suna/pull/4894
• fix(llm): Bedrock connects with bearer+region, live verbatim models.dev catalog by @markokraemer in https://github.com/kortix-ai/suna/pull/4893
• chore(dev-eks): deploy gateway dev-5392ac7b [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4895
• chore(dev-eks): deploy dev-5392ac7b [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4896
• fix(compliance): close AWS patch and detection gaps by @markokraemer in https://github.com/kortix-ai/suna/pull/4897
• feat(connectors): add first-class Postman ingestion by @markokraemer in https://github.com/kortix-ai/suna/pull/4898
• feat(web): overhaul LLM gateway + provider/key manager UX by @markokraemer in https://github.com/kortix-ai/suna/pull/4899
• chore(dev-eks): deploy gateway dev-0919c1c2 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4901
• chore(dev-eks): deploy dev-0919c1c2 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4903
• feat(llm-gateway): AI-SDK transport engine (flag-gated) behind LLM_TRANSPORT_ENGINE by @markokraemer in https://github.com/kortix-ai/suna/pull/4902
• chore(dev-eks): deploy gateway dev-25b574fd [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4904
• chore(dev-eks): deploy dev-25b574fd [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4905
• feat(llm-gateway): gen_ai.* OTel span per gateway call by @markokraemer in https://github.com/kortix-ai/suna/pull/4906
• feat(llm-gateway): Anthropic /v1/messages ingress on the gateway by @markokraemer in https://github.com/kortix-ai/suna/pull/4907
• chore(dev-eks): deploy gateway dev-dad64456 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4909
• feat(api): /v1/generation + /v1/usage OpenRouter-parity read endpoints by @markokraemer in https://github.com/kortix-ai/suna/pull/4908
• chore(dev-eks): deploy dev-cc465f35 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4910
• fix(compliance): codify EC2 CPU alarm coverage by @markokraemer in https://github.com/kortix-ai/suna/pull/4900
• content: publish AGI-ready architecture blog post by @agent-kortix in https://github.com/kortix-ai/suna/pull/4911
• fix(llm-gateway): AI-SDK streaming error handling + bedrock tool-loop + cost-hint parity by @markokraemer in https://github.com/kortix-ai/suna/pull/4914
• chore(dev-eks): deploy gateway dev-2072d456 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4915
• chore(dev-eks): deploy dev-2072d456 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4916
• feat: 12 more business use-case templates (marketing, CS, data, revops) by @lillyboga in https://github.com/kortix-ai/suna/pull/4917
• chore(dev-eks): deploy dev-754cf631 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4918
• fix(compliance): safely adopt IAM group baseline by @markokraemer in https://github.com/kortix-ai/suna/pull/4913
• feat(use-cases): cover art for the 12 new use-case templates by @lillyboga in https://github.com/kortix-ai/suna/pull/4919
• feat(connectors): add unified Discover marketplace by @markokraemer in https://github.com/kortix-ai/suna/pull/4920
• chore(dev-eks): deploy dev-be5dce44 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4921
• feat(llm-gateway): absorb OpenAI Responses API into the ai-sdk engine by @markokraemer in https://github.com/kortix-ai/suna/pull/4924
• chore(dev-eks): deploy gateway dev-760450fa [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4925
• feat(llm-gateway): mount Anthropic /v1/messages ingress, delete legacy /router/messages by @markokraemer in https://github.com/kortix-ai/suna/pull/4922
• chore(dev-eks): deploy gateway dev-bf7de02b [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4926
• fix(llm-gateway): fail fast on terminal upstream auth errors instead of hanging by @markokraemer in https://github.com/kortix-ai/suna/pull/4923
• chore(dev-eks): deploy gateway dev-81e47a87 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4928
• feat: 20 more business use-case templates + covers (USE CASE MAX, 42→62) by @lillyboga in https://github.com/kortix-ai/suna/pull/4927
• revert(connectors): move unified Discover marketplace back to draft by @markokraemer in https://github.com/kortix-ai/suna/pull/4929
• chore(dev-eks): deploy dev-14e31468 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4931
• fix(llm-gateway): strip Bedrock cross-region prefix for pricing lookup by @markokraemer in https://github.com/kortix-ai/suna/pull/4932
• fix(llm-gateway): terminal upstream auth errors surface as non-retryable, not silent 502 by @markokraemer in https://github.com/kortix-ai/suna/pull/4933
• fix(llm-gateway): ai-sdk engine parity — response_format, seed, penalties, logit_bias/logprobs/etc by @markokraemer in https://github.com/kortix-ai/suna/pull/4934
• chore(dev-eks): deploy gateway dev-369cde6e [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4935
• chore(dev-eks): deploy dev-369cde6e [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4936
• fix(llm-gateway): fail fast + clear on a descriptor with no usable baseUrl by @markokraemer in https://github.com/kortix-ai/suna/pull/4938
• chore(dev-eks): deploy gateway dev-0d0bb114 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4939
• chore(dev-eks): deploy dev-0d0bb114 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4940
• fix(compliance): allow Drata SNS subscription inspection by @markokraemer in https://github.com/kortix-ai/suna/pull/4937
• test(llm-gateway): remove unused test declarations by @markokraemer in https://github.com/kortix-ai/suna/pull/4942
• chore(dev-eks): deploy gateway dev-ebf18dfa [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4944
• chore(dev-eks): deploy dev-ebf18dfa [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4945
• test(accessibility): scope decorative contrast audit by @markokraemer in https://github.com/kortix-ai/suna/pull/4946
• feat(llm-gateway): make ai-sdk the sole transport engine; delete native transports + LiteLLM sidecar by @markokraemer in https://github.com/kortix-ai/suna/pull/4943
• chore(dev-eks): deploy gateway dev-ba6b2364 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4948
• chore(dev-eks): deploy dev-ba6b2364 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4949
• Fix release QA staging environment isolation by @markokraemer in https://github.com/kortix-ai/suna/pull/4951
• fix(llm-gateway): catch GatewayResolutionError in /resolve-upstream — stop "Connect Codex" spike (incident 991624588) by @agent-kortix in https://github.com/kortix-ai/suna/pull/4953
• chore(dev-eks): deploy gateway dev-22c1e4ca [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4955
• chore(dev-eks): deploy dev-22c1e4ca [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4956
• Fix staging release QA contracts by @markokraemer in https://github.com/kortix-ai/suna/pull/4954
• chore(dev-eks): deploy dev-06332c1c [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4957
• Fix residual release QA contracts by @markokraemer in https://github.com/kortix-ai/suna/pull/4959
• chore(dev-eks): deploy dev-3cd55231 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4960
• Fix release QA runtime identities by @markokraemer in https://github.com/kortix-ai/suna/pull/4962
• Preserve staging secrets during deployment by @markokraemer in https://github.com/kortix-ai/suna/pull/4964
• test(release): authenticate protected metrics coverage by @markokraemer in https://github.com/kortix-ai/suna/pull/4966
• fix(self-host): isolate black-box compose probes by @markokraemer in https://github.com/kortix-ai/suna/pull/4968
• chore(dev-eks): deploy dev-88330aaa [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4969
• fix(llm-gateway): agent-scope model pins now apply to sessions on the 'default' sentinel by @markokraemer in https://github.com/kortix-ai/suna/pull/4971
• chore(dev-eks): deploy dev-c92f20b0 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4972
• fix(sandbox-proxy): stop 502ing healthy long reasoning/tool turns on blocking POST /session/:id/message by @markokraemer in https://github.com/kortix-ai/suna/pull/4975
• fix(projects): synthesize v2 manifest w/ declared agent for blank projects by @markokraemer in https://github.com/kortix-ai/suna/pull/4974
• fix(snapshots): retry Platinum template builds that never register by @markokraemer in https://github.com/kortix-ai/suna/pull/4977
• fix(auth): project-scoped PATs can drive their own project's sandbox proxy by @markokraemer in https://github.com/kortix-ai/suna/pull/4973
• fix(llm-gateway): scope agent-model pins per project, not per account by @markokraemer in https://github.com/kortix-ai/suna/pull/4978
• chore(dev-eks): deploy dev-7722d516 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4979
• fix(projects): close blank-project AGENT_NOT_DECLARED gaps [#4974] left open by @markokraemer in https://github.com/kortix-ai/suna/pull/4980
• chore(dev-eks): deploy dev-e05b805b [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4981
• feat(connectors): auto-discover source authentication by @markokraemer in https://github.com/kortix-ai/suna/pull/4982
• chore(dev-eks): deploy dev-0b9f4edb [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4985
• docs(llm-gateway): register inference routes in OpenAPI spec by @markokraemer in https://github.com/kortix-ai/suna/pull/4986
• feat(llm-gateway): Models tab in depth — pricing, capabilities, copyable ids by @markokraemer in https://github.com/kortix-ai/suna/pull/4984
• feat(gateway): in-UI API reference for OpenAI/Anthropic/models endpoints by @markokraemer in https://github.com/kortix-ai/suna/pull/4983
• docs(self-host): correct stale ':stable not yet published' claim by @agent-kortix in https://github.com/kortix-ai/suna/pull/4988
• feat(gateway): add Playground tab for comparing models side by side by @markokraemer in https://github.com/kortix-ai/suna/pull/4989
• feat(llm-gateway): verify BYOK provider keys live + disclose custom-provider gateway bypass by @markokraemer in https://github.com/kortix-ai/suna/pull/4990
• docs(self-host): add Backup & DR (enterprise) subsection with RPO/RTO + restore drill by @agent-kortix in https://github.com/kortix-ai/suna/pull/4992
• feat(gateway): routing availability preview + vision-model override editor by @markokraemer in https://github.com/kortix-ai/suna/pull/4991
• ci(self-host): bump fast e2e per-test timeout to 30s (fix release-blocker flake) by @agent-kortix in https://github.com/kortix-ai/suna/pull/4993
• feat(llm-gateway): per-model generation controls (ingest, UI, persistence, injection) by @markokraemer in https://github.com/kortix-ai/suna/pull/4995
• chore(dev-eks): deploy gateway dev-bb305e48 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4997
• chore(dev-eks): deploy dev-bb305e48 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4998
• fix(api): block sandbox agent tokens from account-scoped usage + gateway forensics reads by @agent-kortix in https://github.com/kortix-ai/suna/pull/4999
• chore(dev-eks): deploy dev-9971614f [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5001
• feat(connectors): feature-flag Discover beside Easy Connect by @markokraemer in https://github.com/kortix-ai/suna/pull/5000
• chore(dev-eks): deploy dev-73a5f282 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5003
• feat(session): reasoning-effort selector in the chat composer by @markokraemer in https://github.com/kortix-ai/suna/pull/5002
• fix(llm-catalog): only show reasoning-effort control for models with real reasoning_options by @markokraemer in https://github.com/kortix-ai/suna/pull/5004
• fix(routing): routing-policy PUT 500 when defaultModel is set (missed partial-index ON CONFLICT predicate from [#4978]) by @markokraemer in https://github.com/kortix-ai/suna/pull/5006
• fix(llm-gateway): linear-time trimTrailingSlash (CodeQL js/polynomial-redos, high) by @agent-kortix in https://github.com/kortix-ai/suna/pull/5005
• chore(dev-eks): deploy gateway dev-832d9fea [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5008
• chore(dev-eks): deploy dev-832d9fea [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5009
• apps/web: React Doctor cleanup — dead code purge, session hot-path perf, correctness + a11y fixes by @sutharjay1 in https://github.com/kortix-ai/suna/pull/4994
• chore(dev-eks): deploy gateway dev-0823ba05 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5011
• chore(dev-eks): deploy dev-0823ba05 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5012
• fix(llm-gateway): full models.dev field fidelity + fix selector provider-grouping bug by @markokraemer in https://github.com/kortix-ai/suna/pull/5010
• chore(dev-eks): deploy gateway dev-f4127030 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5015
• chore(dev-eks): deploy dev-f4127030 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5016
• test(ke2e): refresh two stale flow assertions (GW-4 modelGenerationConfig, PROJ-19 v2 blank manifest) by @markokraemer in https://github.com/kortix-ai/suna/pull/5017
• chore(db): reconcile main to staging's shipped migration (main<>staging sync) by @markokraemer in https://github.com/kortix-ai/suna/pull/5020
• chore(dev-eks): deploy dev-266366e9 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5021
• test(ke2e): cover github-app + managed-git + marketplace install-session routes → 83.8% by @agent-kortix in https://github.com/kortix-ai/suna/pull/5023
• chore: remove 11 unused imports flagged by CodeQL js/unused-local-variable by @agent-kortix in https://github.com/kortix-ai/suna/pull/5025
• chore(dev-eks): deploy dev-434498d0 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5026
• test(ke2e): cover the remaining API routes → ~100% coverage by @markokraemer in https://github.com/kortix-ai/suna/pull/5024
• chore: remove 27 more unused imports (CodeQL js/unused-local-variable batch 2) by @agent-kortix in https://github.com/kortix-ai/suna/pull/5028
• chore(dev-eks): deploy dev-a3a87883 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5029
• feat(git-backends): code.storage (Pierre) managed git provider, flag-gated by @markokraemer in https://github.com/kortix-ai/suna/pull/5027
• chore(dev-eks): deploy dev-08787efc [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5030
• docs(runbooks): add enterprise onboarding packet (customer-facing) by @agent-kortix in https://github.com/kortix-ai/suna/pull/5031
• spec(session-boot): 1-second threshold gap analysis + attack sequence by @agent-kortix in https://github.com/kortix-ai/suna/pull/5032
• spec(teams): MS Teams connector Phase D scoping — backend done, CLI surface is the gap by @agent-kortix in https://github.com/kortix-ai/suna/pull/5033
• feat(cli): kortix channels --platform teams (status/connect/manifest) by @agent-kortix in https://github.com/kortix-ai/suna/pull/5034
• fix(github-app): install-callback no longer 500s on a bare hit (no state) by @agent-kortix in https://github.com/kortix-ai/suna/pull/5035
• chore(dev-eks): deploy dev-bf38c80b [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5037
• test(ke2e): add AUD-5 audit surface edge cases (authz, pagination, SSRF, secret-once, cross-account isolation) by @agent-kortix in https://github.com/kortix-ai/suna/pull/5036
• bench(session-boot): Phase 0 benchmark harness — measure create→ready P50/P95/P99 by @agent-kortix in https://github.com/kortix-ai/suna/pull/5038
• chore(dev-eks): deploy dev-3f0aa945 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5039
• spec(llm-gateway): routing/fallback/cost/latency/evals audit + proposal by @agent-kortix in https://github.com/kortix-ai/suna/pull/5040
• seo(aeo): order /api/ai recency-first so freshest content leads by @agent-kortix in https://github.com/kortix-ai/suna/pull/4976
• fix(sandbox): decouple Chromium bake from per-project warm-repo cache miss by @markokraemer in https://github.com/kortix-ai/suna/pull/5042
• chore(dev-eks): deploy gateway dev-03ce16b7 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5043
• chore(dev-eks): deploy dev-03ce16b7 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5045
• content: publish self-hosted AI agent platforms listicle by @agent-kortix in https://github.com/kortix-ai/suna/pull/5041

Full Changelog: https://github.com/kortix-ai/suna/compare/v0.10.10...v0.10.11