Allow older (legacy) BPE models to be detected even when the type is not specified.#1314

xenova merged 2 commits intomainhuggingface/transformers.js:mainfrom

improve-bpe-detectionhuggingface/transformers.js:improve-bpe-detectionCopy head branch name to clipboard