How to suppress the "You're using a Qwen2TokenizerFast tokenizer. Please note that with a fast tokenizer..." #3037
Replies: 1 comment 1 reply
-
Hey! Sadly, that's logging from transformer's side. We've already been limiting many non-axolotl loggers. They may be using |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
so many of the lines in my output is just
"You're using a Qwen2TokenizerFast tokenizer. Please note that with a fast tokenizer, using the
__call__
method is faster than using a method to encode the text followed by a call to thepad
method to get a padded encoding."is there a way to silence it?
Beta Was this translation helpful? Give feedback.
All reactions