Merge branch 'main' into jihao/migration_DYN-1979

Author: jh-nv

components/src/dynamo/trtllm/tests/test_trtllm_handler_base.py

@@ -12,6 +12,7 @@
     pytest.mark.unit,
     pytest.mark.trtllm,
     pytest.mark.pre_merge,
+    pytest.mark.gpu_0,
 ]
 
 

examples/README.md

@@ -46,7 +46,6 @@ Platform-specific deployment guides for production environments:
 - **[Amazon EKS](/examples/deployments/EKS/)** - Deploy Dynamo on Amazon Elastic Kubernetes Service
 - **[Azure AKS](/examples/deployments/AKS/)** - Deploy Dynamo on Azure Kubernetes Service
 - **[Amazon ECS](/examples/deployments/ECS/)** - Deploy Dynamo on Amazon Elastic Container Service
-- **[Router Standalone](/examples/deployments/router_standalone/)** - Standalone router deployment patterns
 - **Google GKE** - _Coming soon_
 
 ## Runtime Examples

examples/basics/kubernetes/Distributed_Inference/disagg_router.yaml

@@ -42,7 +42,7 @@ spec:
             - /bin/sh
             - -c
           args:
-            - python3 -m dynamo.vllm --model meta-llama/Llama-3.1-70B-Instruct -tp 8
+            - python3 -m dynamo.vllm --model meta-llama/Llama-3.1-70B-Instruct -tp 8 --is-decode-worker
     VllmPrefillWorker:
       envFromSecret: hf-token-secret
       componentType: worker