dstack Files

Gateways

GCP

GCP gateways with an ALB can now use certificates managed by Google Cloud Certificate Manager, enabling HTTPS for services behind the gateway with TLS terminated at the load balancer:

:::yaml
type: gateway
name: example-gateway
backend: gcp
region: europe-west4
domain: example.com
replicas: 2
load_balancer:
  type: alb
certificate:
  type: gcp-cm
  name: projects/my-project/locations/europe-west4/certificates/my-certificate

The certificate must be a regional certificate created in the same region as the gateway, referenced by its full resource name. Creating such gateways requires additional GCP permissions:

certificatemanager.certs.use
compute.regionTargetHttpsProxies.create
compute.regionTargetHttpsProxies.delete
compute.regionTargetHttpsProxies.use

Refer to the docs for details.

Replicas

The maximum number of gateway replicas is raised from 3 to 9, and is now configurable server-wide via DSTACK_SERVER_GATEWAY_MAX_REPLICAS.

Replicated gateways are no longer marked experimental. The remaining limitation is that automatic certificate issuance via Let's Encrypt is not supported for them — use acm, gcp-cm, or an external load balancer for TLS termination.

Presets

Public registry

Presets in the dstack Sky registry are private by default and can now be made public. Set Presets to Public in the project settings to let anyone browse and pull the project's presets without signing in, including users of a self-hosted dstack server:

:::shell
$ dstack preset pull main/qwen38-27b-mi300x
OK

Only project admins and global admins can change this setting; enabling it does not let anyone join the project.

What's changed

• [UI] Project visibility: minor UX changes by @peterschmidt85 in https://github.com/dstackai/dstack/pull/4284
• [runner] Terminate the job's whole session, not just its shell by @un-def in https://github.com/dstackai/dstack/pull/4283
• [runner] Make the executor lifecycle explicit by @un-def in https://github.com/dstackai/dstack/pull/4286
• Fix gRPC router workers never becoming ready with model set by @Bihan in https://github.com/dstackai/dstack/pull/4270
• Add DB index for instance_health_checks by @r4victor in https://github.com/dstackai/dstack/pull/4288
• [Presets] Support public presets by @peterschmidt85 in https://github.com/dstackai/dstack/pull/4287
• Collect the last job logs before killing the container by @un-def in https://github.com/dstackai/dstack/pull/4289
• Improve DB connections handling by @r4victor in https://github.com/dstackai/dstack/pull/4291
• Prevent resuming a saved preset by @ZenAlexa in https://github.com/dstackai/dstack/pull/4228
• Support Certificate Manager for GCP gateways by @jvstme in https://github.com/dstackai/dstack/pull/4290
• Increase gateway replica count limit 3 → 9 by @jvstme in https://github.com/dstackai/dstack/pull/4295
• Treat pre-releases as final releases in feature gates by @un-def in https://github.com/dstackai/dstack/pull/4296
• Fix model endpoint protocol with LB-terminated TLS by @jvstme in https://github.com/dstackai/dstack/pull/4299
• Do not downgrade runner and shim by default by @un-def in https://github.com/dstackai/dstack/pull/4297
• Discourage automatic PRs by autonomous agents by @jvstme in https://github.com/dstackai/dstack/pull/4292

New contributors

• @ZenAlexa made their first contribution in https://github.com/dstackai/dstack/pull/4228

Full changelog: https://github.com/dstackai/dstack/compare/0.22.0...0.22.1