Skip to content

Commit 7a0b160

Browse files
committed
rm max_completion_tokens
Signed-off-by: Tyler Michael Smith <[email protected]>
1 parent a4bdbb5 commit 7a0b160

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

src/guidellm/backend/openai.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -468,7 +468,6 @@ def _completions_payload(
468468
max_output_tokens or self.max_output_tokens,
469469
)
470470
payload["max_tokens"] = max_output_tokens or self.max_output_tokens
471-
payload["max_completion_tokens"] = payload["max_tokens"]
472471

473472
if max_output_tokens:
474473
# only set stop and ignore_eos if max_output_tokens set at request level

0 commit comments

Comments
 (0)