Skip to content

Commit 7f4606d

Browse files
author
wangzaijun
committed
fix
1 parent c7d7a1b commit 7f4606d

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

lightllm/server/httpserver/manager.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -604,6 +604,7 @@ async def _wait_to_token_package(
604604
f"prompt_cache_len:{prompt_cache_len} "
605605
f"prompt_cache_ratio:{prompt_cache_ratio} "
606606
f"cpu_prompt_cache_len:{cpu_prompt_cache_len} "
607+
f"used_cpu_prompt_cache_len:{cpu_prompt_cache_len - prompt_cache_len} "
607608
f"mtp_avg_token_per_step:{mtp_avg_token_per_step} "
608609
)
609610
if group_request_id < 0:

0 commit comments

Comments
 (0)