convert: handle when model's tokenization method relies on Mecab#13830

huydt84 wants to merge 9 commits intoggml-org:masterggml-org/llama.cpp:masterfrom

huydt84:huydt/bert-ja-supporthuydt84/llama.cpp:huydt/bert-ja-supportCopy head branch name to clipboard