Skip to content

Commit 220377e

Browse files
committed
Use details for next request in chain
Signed-off-by: Samuel Monson <[email protected]>
1 parent 3f0cdbc commit 220377e

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

src/guidellm/scheduler/worker_group.py

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -496,7 +496,11 @@ def _iter():
496496

497497
count = 0
498498
request_info: ScheduledRequestInfo = None
499-
for request in _iter():
499+
for request_chain in _iter():
500+
if isinstance(request_chain, (list, tuple)):
501+
request = request_chain[0]
502+
else:
503+
request = request_chain
500504
count += 1
501505

502506
if hasattr(request, "request_id"):

0 commit comments

Comments
 (0)