Skip to content

Commit cd6b117

Browse files
committed
update tool_call_parser args
1 parent c5d3e67 commit cd6b117

File tree

2 files changed

+2
-0
lines changed

2 files changed

+2
-0
lines changed

catalog/qwen2-5-0-5b-instruct.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,4 +32,5 @@ spec:
3232
enforce_eager: true
3333
gpu_memory_utilization: 0.95
3434
enable_chunked_prefill: true
35+
tool_call_parser: hermes
3536
served_model_name: Qwen/Qwen2.5-0.5B-Instruct

catalog/qwq-32b-preview.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,4 +32,5 @@ spec:
3232
enforce_eager: true
3333
gpu_memory_utilization: 0.95
3434
enable_chunked_prefill: true
35+
tool_call_parser: hermes
3536
served_model_name: Qwen/QwQ-32B-Preview

0 commit comments

Comments
 (0)