Skip to content

Commit b0f19de

Browse files
tjohnson31415dtrifiro
authored andcommitted
fix after change to MistralTokenizer upstream
Signed-off-by: Travis Johnson <[email protected]>
1 parent a8c8195 commit b0f19de

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

src/vllm_tgis_adapter/grpc/grpc_server.py

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -844,9 +844,7 @@ async def Tokenize(
844844
raise ValueError(
845845
f"{type(tokenizer)} doesn't support the return_offsets option"
846846
)
847-
token_ids = tokenizer.encode(
848-
prompt=req.text,
849-
)
847+
token_ids = tokenizer.encode(req.text)
850848
else:
851849
batch_encoding = tokenizer.encode_plus(
852850
text=req.text,

0 commit comments

Comments
 (0)