输入hi，输出乱码的情况 #543
Unanswered
YuWLong666
asked this question in
Q&A
输入hi，输出乱码的情况
#543
Replies: 1 comment
-
|
@YuWLong666 感谢提问，这个可能和推理框架 vllm 有一定的关系，您可以先尝试使用基本的 Transformers 进行推理，检查情况或者您可以去单独开一个 Issuse 我们会复现你的问题，再次感谢！ |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
请问有朋友碰到过 LLM输入hi，输出乱码的情况吗，环境按照模型要求配置的。在L20服务器正常，H100上就乱码。查了一通，也没查到，网上也没搜到。
Beta Was this translation helpful? Give feedback.
All reactions