Skip to content

[bug] 当流式输出特别大时,reqable占用内存疯狂飙升 #2598

@Plus-L

Description

@Plus-L

Describe the bug
当流式输出特别大时,reqable占用内存疯狂飙升,win11 联想拯救者机器最大占用达9000MB,随后手动关停

Image

To Reproduce
Steps to reproduce the behavior:

  1. 调用一个流式输出量极大的大模型任务
  2. 等待流式输出
  3. 在约第1100个chunk,内存飙升至9000mb

Expected behavior
内存占用可控

Screenshots
If applicable, add screenshots to help explain your problem.

Information

  • Platform: windows
  • OS: 11
  • Arch: x86-64
  • App Version: 3.1.1

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions