Added control to tokenizer for pad_token#418

yusufcakmakk wants to merge 1 commit intoymcui:mainymcui/Chinese-LLaMA-Alpaca-2:mainfrom

yusufcakmakk:tokenizer_pad_checkyusufcakmakk/Chinese-LLaMA-Alpaca-2:tokenizer_pad_checkCopy head branch name to clipboard