You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
-**SGLang:** No flag needed (KV events disabled by default)
137
-
-**TensorRT-LLM:** No flag needed (KV events disabled by default)
138
-
139
-
**TensorRT-LLM only:** The warning `Cannot connect to ModelExpress server/transport error. Using direct download.`
140
-
is expected and can be safely ignored.
141
-
</Note>
142
-
143
-
<Note>
144
-
**Deprecation notice:** vLLM automatically enables KV event publishing when prefix caching is active. In a future release, this will change — KV events will be disabled by default for all backends. Start using `--kv-events-config` explicitly to prepare.
145
-
</Note>
126
+
> [!NOTE]
127
+
> For dependency-free local development, disable KV event publishing (avoids NATS):
> -**SGLang:** No flag needed (KV events disabled by default)
131
+
> -**TensorRT-LLM:** No flag needed (KV events disabled by default)
132
+
>
133
+
> **TensorRT-LLM only:** The warning `Cannot connect to ModelExpress server/transport error. Using direct download.`
134
+
> is expected and can be safely ignored.
135
+
136
+
> [!NOTE]
137
+
> **Deprecation notice:** vLLM automatically enables KV event publishing when prefix caching is active. In a future release, this will change — KV events will be disabled by default for all backends. Start using `--kv-events-config` explicitly to prepare.
Copy file name to clipboardExpand all lines: docs/reference/release-artifacts.md
+11-4Lines changed: 11 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -50,7 +50,8 @@ We recommend using the TensorRT-LLM NGC container instead of the `ai-dynamo[trtl
50
50
|`dynamo-platform-1.0.0`| Platform services (etcd, NATS) and Dynamo Operator for Dynamo cluster |[link](https://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/dynamo-platform-1.0.0.tgz)|
51
51
|`snapshot-1.0.0`| Snapshot DaemonSet for fast GPU worker recovery |[link](https://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/snapshot-1.0.0.tgz)|
52
52
53
-
> **Note:** The `dynamo-crds` Helm chart is deprecated as of v1.0.0; CRDs are now managed by the Dynamo Operator. The `dynamo-graph` Helm chart is deprecated as of v0.9.0.
53
+
> [!NOTE]
54
+
> The `dynamo-crds` Helm chart is deprecated as of v1.0.0; CRDs are now managed by the Dynamo Operator. The `dynamo-graph` Helm chart is deprecated as of v0.9.0.
54
55
55
56
### Rust Crates
56
57
@@ -70,7 +71,8 @@ We recommend using the TensorRT-LLM NGC container instead of the `ai-dynamo[trtl
70
71
71
72
### Container Images (NGC)
72
73
73
-
> For detailed run instructions, see the [Container README](https://github.com/ai-dynamo/dynamo/tree/main/container/README.md) or backend-specific guides: [vLLM](../backends/vllm/README.md) | [SGLang](../backends/sglang/README.md) | [TensorRT-LLM](../backends/trtllm/README.md)
74
+
> [!TIP]
75
+
> For detailed run instructions, see the backend-specific guides: [vLLM](../backends/vllm/README.md) | [SGLang](../backends/sglang/README.md) | [TensorRT-LLM](../backends/trtllm/README.md)
> For API documentation, see each crate on [docs.rs](https://docs.rs/). To build Dynamo from source, see [Building from Source](https://github.com/ai-dynamo/dynamo#building-from-source).
125
130
126
131
```bash
@@ -341,7 +346,8 @@ For a complete list of known issues, refer to the release notes for each version
341
346
342
347
#### dynamo-crds (Helm chart) -- Deprecated
343
348
344
-
> **Note:** The `dynamo-crds` Helm chart is deprecated as of v1.0.0. CRDs are now managed by the Dynamo Operator.
349
+
> [!NOTE]
350
+
> The `dynamo-crds` Helm chart is deprecated as of v1.0.0. CRDs are now managed by the Dynamo Operator.
345
351
346
352
| Chart | Notes |
347
353
|-------|-------|
@@ -377,7 +383,8 @@ For a complete list of known issues, refer to the release notes for each version
377
383
378
384
#### dynamo-graph (Helm chart) -- Deprecated
379
385
380
-
> **Note:** The `dynamo-graph` Helm chart is deprecated as of v0.9.0.
386
+
> [!NOTE]
387
+
> The `dynamo-graph` Helm chart is deprecated as of v0.9.0.
0 commit comments