Skip to content

Commit 6f757a0

Browse files
authored
Update gptoss-20b-vllm-g5.yaml
1 parent 11b02a3 commit 6f757a0

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

genai-examples/gptoss-20b-vllm-g5.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,7 @@ spec:
3232
- "--port=8000"
3333
- "--trust-remote-code"
3434
- "--max-model-len=2048"
35+
- "--max-num-seqs=2"
3536
- "--tensor-parallel-size=1"
3637
- "--enable-auto-tool-choice"
3738
- --tool-call-parser=openai

0 commit comments

Comments
 (0)