Skip to content

Commit 7cd0bd7

Browse files
authored
[Bugfix] Fix output token length check logic (#16419)
Signed-off-by: look <[email protected]>
1 parent 56d4aef commit 7cd0bd7

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

benchmarks/benchmark_serving.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -156,7 +156,7 @@ def calculate_metrics(
156156
if outputs[i].success:
157157
output_len = outputs[i].output_tokens
158158

159-
if output_len is None:
159+
if not output_len:
160160
# We use the tokenizer to count the number of output tokens
161161
# for some serving backends instead of looking at
162162
# len(outputs[i].itl) since multiple output tokens may be

0 commit comments

Comments
 (0)