Skip to content

Commit be8b7ee

Browse files
jathukeyprocedure
authored andcommitted
Update pytorch-labs/tokenizers to 295ee78 (pytorch#10161)
### Summary Update tokenizers lib to include meta-pytorch/tokenizers#46. ### Test plan CI
1 parent f16cf3e commit be8b7ee

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

extension/llm/tokenizers

0 commit comments

Comments
 (0)