Skip to content

Commit 041428d

Browse files
committed
fix(deps): add sentencepiece
Some tokenizers rely on sentencepiece for fast/slow conversions. Add it to base dependencies so model loading succeeds.
1 parent cc02960 commit 041428d

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

pyproject.toml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,7 @@ dependencies = [
3838
"gguf>=0.6.0",
3939
"kernels>=0.3.0",
4040
"protobuf>=4.25.0",
41+
"sentencepiece>=0.2.0",
4142
"httpx>=0.25.0",
4243
]
4344

0 commit comments

Comments
 (0)