dstack is an open-source tool designed to enhance the efficiency of running ML workloads in any cloud (AWS, GCP, Azure, Lambda, etc). It streamlines development and deployment, reduces cloud costs, and frees users from vendor lock-in.

Features

  • dstack is an open-source tool that simplifies LLM development across multiple clouds
  • To use dstack, install it with pip, and start the server
  • To run a configuration, use the dstack run command and pass the path to the directory with the configuration
  • The CLI automatically provisions the required cloud resources and forwards the ports to your local machine
  • Licensed under the Mozilla Public License
  • A configuration is a YAML file that describes what you want to run

Project Samples

Project Activity

See All Activity >

License

Mozilla Public License 1.0 (MPL)

Follow dstack

dstack Web Site

Other Useful Business Software
Host LLMs in Production With On-Demand GPUs Icon
Host LLMs in Production With On-Demand GPUs

NVIDIA L4 GPUs. 5-second cold starts. Scale to zero when idle.

Deploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of dstack!

Additional Project Details

Operating Systems

Mac

Programming Language

Python

Related Categories

Python Machine Learning Software, Python LLM Inference Tool

Registered

2023-07-19