0.19.5
CLI
Offers
You can now list available offers (hardware configurations) from the configured backends using the CLI—without needing to define a run configuration. Just run dstack offer
and specify the resource requirements. The CLI will output available offers, including backend, region, instance type, resources, spot availability, and pricing:
$ dstack offer --gpu H100:1.. --max-offers 10
# BACKEND REGION INSTANCE TYPE RESOURCES SPOT PRICE
1 datacrunch FIN-01 1H100.80S.30V 30xCPU, 120GB, 1xH100 (80GB), 100.0GB (disk) no $2.19
2 datacrunch FIN-02 1H100.80S.30V 30xCPU, 120GB, 1xH100 (80GB), 100.0GB (disk) no $2.19
3 datacrunch FIN-02 1H100.80S.32V 32xCPU, 185GB, 1xH100 (80GB), 100.0GB (disk) no $2.19
4 datacrunch ICE-01 1H100.80S.32V 32xCPU, 185GB, 1xH100 (80GB), 100.0GB (disk) no $2.19
5 runpod US-KS-2 NVIDIA H100 PCIe 16xCPU, 251GB, 1xH100 (80GB), 100.0GB (disk) no $2.39
6 runpod CA NVIDIA H100 80GB HBM3 24xCPU, 251GB, 1xH100 (80GB), 100.0GB (disk) no $2.69
7 nebius eu-north1 gpu-h100-sxm 16xCPU, 200GB, 1xH100 (80GB), 100.0GB (disk) no $2.95
8 runpod AP-JP-1 NVIDIA H100 80GB HBM3 20xCPU, 251GB, 1xH100 (80GB), 100.0GB (disk) no $2.99
9 runpod CA-MTL-1 NVIDIA H100 80GB HBM3 28xCPU, 251GB, 1xH100 (80GB), 100.0GB (disk) no $2.99
10 runpod CA-MTL-2 NVIDIA H100 80GB HBM3 26xCPU, 125GB, 1xH100 (80GB), 100.0GB (disk) no $2.99
...
Shown 10 of 99 offers, $127.816 max
Learn more about how the new CLI works in the reference
Configuration
Resource tags
It's now possible to set custom resource-level tags using the new tags
property:
type: dev-environment
ide: vscode
tags:
my_custom_tag: some_value
another_tag: another_value_123
The tags
property is supported by all configuration types: runs, fleets, volumes, gateways, and profiles. The tags are propagated to the underlying cloud resources on backends that support tags. Currently, it's AWS, Azure, and GCP.
Shell configuration
With the new shell
property you can specify the shell used to run commands
(or init
for dev environments):
type: task
image: ubuntu
shell: bash
commands:
# now we can use Bash features, e.g., arrays:
- words=(dstack is)
- words+=(awesome)
- echo ${words[@]} # prints "dstack is awesome"
GCP
A3 High and A3 Edge
dstack
now automatically sets up GCP A3 High and A3 Edge instances with GPUDirect-TCPX optimized NCCL communication.
An example on how to provision an A3 High cluster and run NCCL tests on it using dstack
is coming soon!
Volumes
Total cost
The UI now shows volumes total cost and termination date alongside volume price. Previously, only the price information was available.
What's changed
- Update Axolotl Examples by @Bihan in #2502
- Update TGI Example with Llama 4 Scout by @Bihan in #2529
- Implement custom per-resource tags by @r4victor in #2533
- Add try_advisory_lock_ctx by @r4victor in #2537
- [chore]: Drop
is_core_model_instance
by @jvstme in #2536 - [runner] Rework env variables exporting by @un-def in #2535
- Fix ruff version discrepancy by @jvstme in #2539
- Add volume cost by @r4victor in #2541
- Add
shell
run property by @un-def in #2542 - [Feature]: Support
dstack offer
#2142 by @peterschmidt85 in #2540 - Update Llama4 Readme with Axolotl fine-tuning example by @Bihan in #2545
- [Docs] Document
dstack offer
by @peterschmidt85 in #2546 - [Docs]: Replace vRAM -> VRAM by @jvstme in #2548
- Include statics as artifacts in both wheel and sdist by @r4victor in #2544
- Support A3 High/Edge GCP clusters with GPUDirect-TCPX by @r4victor in #2549
Full changelog: 0.19.4...0.19.5