Implement LRU cache for BPE tokenizer#1283

xenova merged 4 commits intomainhuggingface/transformers.js:mainfrom

tokenizer-lru-cachehuggingface/transformers.js:tokenizer-lru-cacheCopy head branch name to clipboard