We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent a39bebc commit db3a38bCopy full SHA for db3a38b
requirements-dev.txt
@@ -29,4 +29,4 @@ data
29
wget
30
huggingface_hub>=0.19.2
31
tiktoken
32
-tokenizers<0.21,<0.22
+tokenizers<0.21
0 commit comments