vllm调用128k的，停不下来呀。后面的都是重复的。 #986
Closed
lvbinandylau
started this conversation in
General
Replies: 3 comments
-
|
special token设置有问题 |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
把这个配置 https://huggingface.co/THUDM/chatglm3-6b/blob/main/tokenizer_config.json 换到 chatglm3-128k试试 |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
不行，还是一直重复 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
vllm调用128k的，停不下来呀。后面的都是重复的。
Beta Was this translation helpful? Give feedback.
All reactions