Skip to content

Commit 2bf2de3

Browse files
authored
Bump tokenizers to b007644 (#14638)
### Summary Update tokenizers to pick up meta-pytorch/tokenizers@b007644, which fixes an issue when referencing tokenizers via CMake find_package on Windows. ### Test plan CI
1 parent d09dd79 commit 2bf2de3

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

extension/llm/tokenizers

0 commit comments

Comments
 (0)