Skip to content

Commit dfaf886

Browse files
committed
Count first decode token in first_iter_counts
Signed-off-by: Samuel Monson <[email protected]>
1 parent 82cfb96 commit dfaf886

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/guidellm/benchmark/benchmark.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -817,7 +817,7 @@ def from_stats(
817817
],
818818
iter_counts=[req.output_tokens for req in total_with_output_first],
819819
first_iter_counts=[
820-
req.prompt_tokens for req in total_with_output_first
820+
req.prompt_tokens + 1 for req in total_with_output_first
821821
],
822822
),
823823
),

0 commit comments

Comments
 (0)