Skip to content

Commit 3823ad5

Browse files
committed
fix: fix path and yaml
Signed-off-by: Wangzy <[email protected]>
1 parent 21e1931 commit 3823ad5

File tree

1 file changed

+21
-0
lines changed

1 file changed

+21
-0
lines changed
Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
apiVersion: networking.serving.volcano.sh/v1alpha1
2+
kind: ModelServer
3+
metadata:
4+
name: deepseek-r1-1-5b-pd-disaggragation
5+
namespace: default
6+
spec:
7+
workloadSelector:
8+
matchLabels:
9+
app: deepseek-r1-1-5b
10+
pdGroup:
11+
groupKey: "modelinfer/infergroupname"
12+
prefillLabels:
13+
modelinfer/rolename: "P-instance"
14+
decodeLabels:
15+
modelinfer/rolename: "D-instance"
16+
workloadPort:
17+
port: 8000
18+
model: "deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B"
19+
inferenceEngine: "vLLM"
20+
trafficPolicy:
21+
timeout: 10s

0 commit comments

Comments
 (0)