Skip to content

Commit 227ec36

Browse files
committed
修改 glm4-9b模型在lmdeploy-turbo下推理异常的问题
1 parent e30d1e3 commit 227ec36

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

gpt_server/model_worker/chatglm.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -95,7 +95,7 @@ async def generate_stream_gate(self, params):
9595
params["prompt"] = text
9696
params["input_ids"] = input_ids
9797
# ---------------添加额外的参数------------------------
98-
params["messages"] = messages
98+
params["messages"] = text
9999
params["stop"].extend(self.stop)
100100
params["stop_words_ids"] = self.stop_words_ids
101101
# ---------------添加额外的参数------------------------

0 commit comments

Comments
 (0)