Skip to content

Commit f1e9707

Browse files
author
root
committed
update router mananger
1 parent 2f62a86 commit f1e9707

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

lightllm/server/router/manager.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -496,7 +496,7 @@ async def _recv_new_reqs_and_schedule(self):
496496
if self.is_multinode_tp:
497497
self._multinode_tp_generate_new_batch()
498498
else:
499-
if self._get_paused_req_num() == 0 and self.shm_reqs_io_buffer.is_empty():
499+
if self._get_paused_req_num() == 0:
500500
self._generate_new_batch()
501501
return
502502

0 commit comments

Comments
 (0)