feat: Normalizer::normalize_str — skip NormalizedString allocation#2020

Open

ArthurZucker wants to merge 7 commits intomainfrom

fast-normalize-str

Commits on Apr 23, 2026

Merge branch 'main' into fast-normalize-str
ArthurZucker
authored
perf: use normalize_str in AddedVocabulary to skip NormalizedString allocation

ArthurZucker
and
claude
committed
perf: extract_and_normalize_fast — skip alignment tracking for encode_fast
ArthurZucker
committed