We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 07b25cc commit 47de522Copy full SHA for 47de522
Qwen/Qwen2.5-7B-Instruct/accuracy/server.yml
@@ -1,6 +1,5 @@
1
# https://huggingface.co/Qwen/Qwen2.5-7B-Instruct
2
model: "Qwen/Qwen2.5-7B-Instruct"
3
trust-remote-code: true
4
-add-bos-token: false
5
tensor-parallel-size: 1
6
max-model-len: 8192
0 commit comments