Skip to content

convert : handle tokenizer merges format from transformers 4.45#9696

Merged
ggerganov merged 2 commits intomasterfrom
compilade/convert-merges-pairs-to-old
Oct 3, 2024
Merged

convert : handle tokenizer merges format from transformers 4.45#9696
ggerganov merged 2 commits intomasterfrom
compilade/convert-merges-pairs-to-old

Commits