Skip to content

Commit 098ae9d

Browse files
committed
fix
1 parent 0e3cdb7 commit 098ae9d

File tree

1 file changed

+1
-1
lines changed
  • lightllm/server/router/model_infer/mode_backend/chunked_prefill

1 file changed

+1
-1
lines changed

lightllm/server/router/model_infer/mode_backend/chunked_prefill/impl.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -329,7 +329,7 @@ def decode_mtp(
329329
run_reqs_update_packs=update_packs,
330330
extra_post_req_handle_func=self.extra_post_req_handle_func,
331331
)
332-
if need_free_mem_indexes:
332+
if len(need_free_mem_indexes) > 0:
333333
g_infer_state_lock.acquire()
334334
g_infer_context.req_manager.mem_manager.free(need_free_mem_indexes)
335335
g_infer_state_lock.release()

0 commit comments

Comments
 (0)