This repository was archived by the owner on Sep 10, 2025. It is now read-only.
Simplify TokenizerArgs.__post_init__ with Enum Tokenizer Type#1535
Merged
zhenyan-zhang-meta merged 7 commits intomainfrom Apr 28, 2025
Merged
Simplify `TokenizerArgs.__post_init__` with Enum Tokenizer Type#1535zhenyan-zhang-meta merged 7 commits intomainfrom
zhenyan-zhang-meta merged 7 commits intomainfrom
Commits
Commits on Apr 25, 2025
- committed
zhenyanzhang - authored andcommitted
- committed
- committed
- committed
Commits on Apr 28, 2025
- committed
- committed