Skip to content

[Bug] Problems with docking local model output #2560

@armored-glitch

Description

@armored-glitch

Contact Information

[email protected]

MaxKB Version

v1.10.1

Problem Description

  1. 首个标签没有输出
  2. 输出大约800 字后就停止输出(挑战token 长度依旧无效),对接其他工具输出是正常的
  3. 思考过程未输出完毕,就开始回答的。且还会出现正式内容回答完毕,接着继续输出思考过程

Steps to Reproduce

使用vLLM 对接本地大模型会出现

The expected correct result

No response

Related log output

Additional Information

Image

Image

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions