在使用chatglm3与langchain报出CUDA error: device-side assert #557
Closed
bearbee123
started this conversation in
Bad Case
Replies: 1 comment
-
|
#393 这里可以讨论 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
在使用_call函数中使用model.stream_chat或者model.chat方法如果接受到来自lanchain查询向量库RetrievalQA.from_chain_type返回的prompt后，进行多轮回答每次显存都会不断增加，直到显存爆掉出现CUDA error: device-side assert的错误
已经不知道怎么办了，求助！！！
Beta Was this translation helpful? Give feedback.
All reactions