Skip to content

Commit ba99d24

Browse files
authored
chore: disagg + router k8s recipe minor changes (#4050)
Signed-off-by: PeaBrane <[email protected]>
1 parent e3ba40e commit ba99d24

File tree

2 files changed

+3
-1
lines changed

2 files changed

+3
-1
lines changed

examples/backends/vllm/deploy/disagg.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,7 @@ spec:
3434
args:
3535
- --model
3636
- Qwen/Qwen3-0.6B
37+
- --is-decode-worker
3738
VllmPrefillWorker:
3839
dynamoNamespace: vllm-disagg
3940
envFromSecret: hf-token-secret

examples/backends/vllm/deploy/disagg_router.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,11 +36,12 @@ spec:
3636
args:
3737
- --model
3838
- Qwen/Qwen3-0.6B
39+
- --is-decode-worker
3940
VllmPrefillWorker:
4041
dynamoNamespace: vllm-v1-disagg-router
4142
envFromSecret: hf-token-secret
4243
componentType: worker
43-
replicas: 1
44+
replicas: 2
4445
resources:
4546
limits:
4647
gpu: "1"

0 commit comments

Comments
 (0)