Skip to content

Commit 3e0c8cc

Browse files
author
Weichao Luo
committed
fix.
1 parent a9995b3 commit 3e0c8cc

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

lightllm/server/router/model_infer/mode_backend/pd_nixl/impl_for_pd_prefill.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -57,4 +57,5 @@ def decode(self):
5757
extra_post_req_handle_func=self._handle_chunked_transfer,
5858
call_post_handle_for_chunk=True,
5959
)
60+
self._overlap_req_init_and_filter(uninit_reqs=uinit_reqs, ok_finished_reqs=ok_finished_reqs, clear_list=True)
6061
return

0 commit comments

Comments
 (0)