在使用chatglm3与langchain报出CUDA error: device-side assert #557
Closed
bearbee123
started this conversation in
Bad Case
Replies: 1 comment
-
|
#393 这里可以讨论 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
在使用_call函数中使用model.stream_chat或者model.chat方法如果接受到来自lanchain查询向量库RetrievalQA.from_chain_type返回的prompt后，进行多轮回答每次显存都会不断增加，直到显存爆掉出现CUDA error: device-side assert的错误
已经不知道怎么办了，求助！！！
Beta Was this translation helpful? Give feedback.
All reactions