Skip to content

Commit d1538d4

Browse files
committed
switch metric to pull from tpot instead of itl
Signed-off-by: dalthecow <[email protected]>
1 parent 1261fe8 commit d1538d4

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/guidellm/presentation/data_models.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -218,7 +218,7 @@ def from_benchmark(cls, bm: "GenerativeBenchmark"):
218218
return cls(
219219
requests_per_second=bm.metrics.requests_per_second.successful.mean,
220220
tpot=TabularDistributionSummary.from_distribution_summary(
221-
bm.metrics.inter_token_latency_ms.successful
221+
bm.metrics.time_per_output_token_ms.successful
222222
),
223223
ttft=TabularDistributionSummary.from_distribution_summary(
224224
bm.metrics.time_to_first_token_ms.successful

0 commit comments

Comments
 (0)