dstack Files

Backends

Daytona

dstack now supports Daytona as a backend for CPU and GPU dev environments, tasks, and services, including multi-GPU configurations with NVIDIA and AMD GPUs.

:::shell
$ dstack offer -b daytona --gpu B300,MI355X,H200:1..8 --max-offers 3

 #  BACKEND          RESOURCES                                     INSTANCE TYPE           PRICE
 1  daytona (earth)  cpu=x86:1 mem=1GB disk=1GB gpu=H200:141GB:1     1x-H200-1cpu-1gb-1gb    $4.6067
 2  daytona (earth)  cpu=x86:1 mem=1GB disk=1GB gpu=MI355X:288GB:1   1x-MI355X-1cpu-1gb-1gb  $6.0567
 3  daytona (earth)  cpu=x86:1 mem=1GB disk=1GB gpu=B300:270GB:1     1x-B300-1cpu-1gb-1gb    $7.1667
    ...
 Shown 3 of 19 offers, $47.986708max

dstack’s Daytona integration also supports volumes. Daytona provides these as S3-backed FUSE mounts, allowing multiple instances to mount the same volume simultaneously across regions.

See the backend documentation for configuration and required permissions.

Presets

Replica groups

Preset creation now uses a separate router for regular inference as well as prefill-decode disaggregation when the fleet has placement: cluster and a CPU-only instance for the router.

Trials use task node groups, and the final service uses replica groups to run the router and GPU workers separately. Workers connect over gRPC when supported, and all benchmarks run through the router.

What's Changed

• Refactor dstack for dstack Factory extension by @r4victor in https://github.com/dstackai/dstack/pull/4303
• [Website] Updated product pages by @peterschmidt85 in https://github.com/dstackai/dstack/pull/4304
• Fix GCP a3-edgegpu-8g and a3-highgpu-8g by @jvstme in https://github.com/dstackai/dstack/pull/4307
• Fix errors in service router worker sync by @un-def in https://github.com/dstackai/dstack/pull/4305
• Clarify Kubernetes volume context selection by @peterschmidt85 in https://github.com/dstackai/dstack/pull/4311
• [Website] Updated Slurm info on landing by @peterschmidt85 in https://github.com/dstackai/dstack/pull/4312
• Set upper bound of SQLAlchemy version to < 2.1 by @un-def in https://github.com/dstackai/dstack/pull/4314
• Don't require probes to pass in router worker sync by @un-def in https://github.com/dstackai/dstack/pull/4313
• Polish landing pages by @peterschmidt85 in https://github.com/dstackai/dstack/pull/4319
• OCI: resolve availability domains from the configured compartment by @fede-kamel in https://github.com/dstackai/dstack/pull/4309
• Sync workers with every running router by @un-def in https://github.com/dstackai/dstack/pull/4320
• Restore model probe for service routers by @un-def in https://github.com/dstackai/dstack/pull/4322
• [Presets] Update system_prompt for router usage by @Bihan in https://github.com/dstackai/dstack/pull/4294
• Parse Crusoe quota counters returned as strings by @r4victor in https://github.com/dstackai/dstack/pull/4323
• [UI] Fix job metrics tab by @un-def in https://github.com/dstackai/dstack/pull/4324
• Disable gateway proxy buffering for model services by @r4victor in https://github.com/dstackai/dstack/pull/4326
• Apply DSTACK_SERVICE_CLIENT_TIMEOUT to gateway nginx and app by @r4victor in https://github.com/dstackai/dstack/pull/4327
• Add Daytona backend by @peterschmidt85 in https://github.com/dstackai/dstack/pull/4321
• Pin Nebius spot price at provisioning time by @jvstme in https://github.com/dstackai/dstack/pull/4328
• Add OCI experimental_instance_types setting by @jvstme in https://github.com/dstackai/dstack/pull/4329

New Contributors

• @fede-kamel made their first contribution in https://github.com/dstackai/dstack/pull/4309

Full Changelog: https://github.com/dstackai/dstack/compare/0.22.1...0.22.2