Skip to content

Commit 4f1a652

Browse files
southfreebirdnjhill
andcommitted
Update vllm/v1/sample/logits_processor/__init__.py
Co-authored-by: Nick Hill <[email protected]> Signed-off-by: Sergei Skvortsov <[email protected]>
1 parent 3bc2ffa commit 4f1a652

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

vllm/v1/sample/logits_processor/__init__.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -196,9 +196,9 @@ def build_logitsprocs(
196196
if vllm_config.speculative_config:
197197
if custom_logitsprocs:
198198
raise ValueError(STR_SPEC_DEC_REJECTS_LOGITSPROCS)
199-
logger.debug(
200-
"Skipping logits processor loading because "
201-
"they are not supported when speculative decoding is enabled."
199+
logger.warning(
200+
"min_p, logit_bias, and min_tokens parameters won't currently work "
201+
"with speculative decoding enabled."
202202
)
203203
return LogitsProcessors()
204204

0 commit comments

Comments
 (0)