Skip to content

Commit 8843b7b

Browse files
committed
👋 Remove backend parameter from GuidedDecodingParams (#4123)
1 parent 7c174e0 commit 8843b7b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

trl/scripts/vllm_serve.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -557,7 +557,7 @@ async def generate(request: GenerateRequest):
557557

558558
# Guided decoding, if enabled
559559
if request.guided_decoding_regex is not None:
560-
guided_decoding = GuidedDecodingParams(backend="outlines", regex=request.guided_decoding_regex)
560+
guided_decoding = GuidedDecodingParams(regex=request.guided_decoding_regex)
561561
else:
562562
guided_decoding = None
563563

0 commit comments

Comments
 (0)