Skip to content

Commit 73e1a6b

Browse files
authored
fix
1 parent a06e162 commit 73e1a6b

File tree

1 file changed

+4
-2
lines changed

1 file changed

+4
-2
lines changed

lightllm/server/httpserver/manager.py

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -395,8 +395,10 @@ async def abort(self, group_request_id):
395395
return
396396

397397
async def handle_loop(self):
398-
self.forwarding_queue = AsyncQueue()
399-
asyncio.create_task(self.pd_handle_loop())
398+
399+
if self.pd_mode.is_P_or_D():
400+
self.forwarding_queue = AsyncQueue()
401+
asyncio.create_task(self.pd_handle_loop())
400402

401403
while True:
402404
recv_ans: BatchStrOut = await self.recv_from_detokenization.recv_pyobj()

0 commit comments

Comments
 (0)