dstack Files

Accelerators

Tenstorrent

The update adds support for Tenstorrent Blackhole accelerators, including PCIe cards and systems such as LoudBox, QuietBox, and Galaxy. Previously dstack supported only Tenstorrent Wormhole accelerators. Also, we've reworked the Tenstorrent example.

Backends

Vast.ai

The vastai backend gets new backend-specific options in run and fleet configurations for advanced offers filtering:

:::yaml
type: dev-environment
backend_options:

- type: vastai
  offer_order: price
  min_reliability: 0.97
  min_score: 250

See the YAML reference for more details on new backend_options.

Examples

Miles

A new Miles example shows how to use dstack and Miles for reinforcement learning (RL) post-training of a 32B language model with GRPO across a multi-node cluster.

Breaking changes

• Dropped support for AWS P3 instances (V100).

What's changed

• [Docs]Add AMD Mi300x PD-Disaggregation Example by @Bihan in https://github.com/dstackai/dstack/pull/3890
• Display imported gateways in project settings UI by @jvstme in https://github.com/dstackai/dstack/pull/3893
• [chore]: Refactor get_job_plans() by @jvstme in https://github.com/dstackai/dstack/pull/3894
• Update TT-SMI Docker image build by @peterschmidt85 in https://github.com/dstackai/dstack/pull/3900
• Discover and use the latest AWS Ubuntu 22.04 DLAMI by @jvstme in https://github.com/dstackai/dstack/pull/3899
• Drop AWS P3 support and use DLAMI for all AWS GPU instances by @r4victor in https://github.com/dstackai/dstack/pull/3903
• Fix placement groups missing project attribute by @r4victor in https://github.com/dstackai/dstack/pull/3905
• Improve AMD accelerator example by @peterschmidt85 in https://github.com/dstackai/dstack/pull/3901
• [Docs]Add Miles Example by @Bihan in https://github.com/dstackai/dstack/pull/3907
• Add Vast.ai-specific profile options by @jvstme in https://github.com/dstackai/dstack/pull/3909
• Do not pass minCudaVersion for RunPod clusters by @r4victor in https://github.com/dstackai/dstack/pull/3911
• Add Tenstorrent Blackhole support by @peterschmidt85 in https://github.com/dstackai/dstack/pull/3895
• [Internal]: Drop unused pre-pull parameter in images CI by @jvstme in https://github.com/dstackai/dstack/pull/3912
• Fix Vast.ai offer order in dstack offer --fleet by @jvstme in https://github.com/dstackai/dstack/pull/3897

Full changelog: https://github.com/dstackai/dstack/compare/0.20.21...0.20.22