[bugfix] tokenizers respect padding: true with non-null max_length#1284
Merged
xenova merged 4 commits intohuggingface:mainfrom Apr 30, 2025
dwisdom0:dwisdom0/patch-tokenizers-padding
Merged
[bugfix] tokenizers respect padding: true with non-null max_length#1284xenova merged 4 commits intohuggingface:mainfrom dwisdom0:dwisdom0/patch-tokenizers-padding
xenova merged 4 commits intohuggingface:mainfrom
dwisdom0:dwisdom0/patch-tokenizers-padding
Commits
Commits on Apr 14, 2025
Commits on Apr 30, 2025
- committed
- committed
- committed
