Add special tokens in text-generation pipeline if tokenizer requires#1370

xenova merged 5 commits intomainhuggingface/transformers.js:mainfrom

default-pipeline-optionshuggingface/transformers.js:default-pipeline-optionsCopy head branch name to clipboard