0.19.2

Nebius

This update introduces an integration with Nebius, a cloud provider offering top-tier NVIDIA GPUs at competitive prices.

$ dstack apply
 #  BACKEND  REGION     RESOURCES                        SPOT  PRICE
 1  nebius   eu-north1  8xCPU, 32GB, 1xL40S (48GB)       no    $1.5484
 2  nebius   eu-north1  16xCPU, 200GB, 1xH100 (80GB)     no    $2.95
 3  nebius   eu-north1  16xCPU, 200GB, 1xH200 (141GB)    no    $3.5
 4  nebius   eu-north1  64xCPU, 384GB, 2xL40S (48GB)     no    $4.5688
 5  nebius   eu-north1  128xCPU, 768GB, 4xL40S (48GB)    no    $9.1376
 6  nebius   eu-north1  128xCPU, 1600GB, 8xH100 (80GB)   no    $23.6
 7  nebius   eu-north1  128xCPU, 1600GB, 8xH200 (141GB)  no    $28

The new nebius backend supports CPU and GPU instances, fleets, distributed tasks, and more. Support for network volumes and enhanced inter-node connectivity is coming in future releases. See the docs for instructions on configuring Nebius in your dstack project.

Metrics

This release brings a long-awaited feature — the Metrics page in the UI:

In addition, the dstack stats command was renamed to dstack metrics and updated — previously, the max value of CPU utilization depended on a number of CPUs (for example, it was 400% for 4-core CPU), now it's normalized to 100%.

$ dstack metrics nccl-tests
 NAME        CPU  MEMORY            GPU
 nccl-tests  81%  2754MB/1638400MB  #0 100740MB/144384MB 100% Util
                                    #1 100740MB/144384MB 100% Util
                                    #2 100740MB/144384MB 99% Util
                                    #3 100740MB/144384MB 99% Util
                                    #4 100740MB/144384MB 99% Util
                                    #5 100740MB/144384MB 99% Util
                                    #6 100740MB/144384MB 99% Util
                                    #7 100740MB/144384MB 100% Util

What's Changed

• [Docs] Update the home page to include a updated diagram by @peterschmidt85 in #2450
• Update ChatCompletionsChunk for Deepseek-R1 response by @Bihan in #2452
• [Blog] Minor blog refactoring by @peterschmidt85 in #2457
• [Blog] Accessing dev environments with Cursor by @peterschmidt85 in #2456
• Move cachetools to base deps by @r4victor in #2459
• [Blog] Prometheus by @peterschmidt85 in #2458
• Add optional bearer auth to metrics endpoint by @un-def in #2460
• [CLI] Rename stats command to metrics by @un-def in #2462
• Add SgLang Example by @Bihan in #2461
• Update NIM example with DeepSeek-R1-Distill by @Bihan in #2454
• [Blog] Supporting MPI and NCCL/RCCL tests by @peterschmidt85 in #2465
• Add Nebius backend by @jvstme in #2463
• [Feature] Show Run metrics on the UI by @olgenn in #2446
• [CLI] Divide CPU util by a number of vCPUs in dstack metrics by @un-def in #2466

Full Changelog: 0.19.1...0.19.2