feat: parse padding settings from tokenizer_config.json#183

besaleli merged 16 commits intomainmozilla-ai/encoderfile:mainfrom

179-optionally-embed-tokenizer_configjson-2mozilla-ai/encoderfile:179-optionally-embed-tokenizer_configjson-2Copy head branch name to clipboard