Skip to content
This repository was archived by the owner on Sep 4, 2025. It is now read-only.

Commit 78a8dfe

Browse files
tjohnson31415heyselbi
authored andcommitted
TEMP: no shared tokenizer from PR-3512
Gotta get conflicts with the main line figured resolved first. Just don't use the shared tokenizer for now. Signed-off-by: Travis Johnson <[email protected]>
1 parent d976df3 commit 78a8dfe

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm/entrypoints/grpc/grpc_server.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -118,7 +118,8 @@ def __init__(self, engine: AsyncLLMEngine, args: argparse.Namespace):
118118

119119
async def _post_init(self):
120120
self.config = await self.engine.get_model_config()
121-
self.tokenizer_group = await self.engine.get_tokenizer_group()
121+
# self.tokenizer_group = await self.engine.get_tokenizer_group()
122+
self.tokenizer_group = self.engine.engine.tokenizer
122123
self.tokenizer = await self.engine.get_tokenizer()
123124

124125
# Swap in the special TGIS stats logger

0 commit comments

Comments
 (0)