Freezing of CATS_SCORE and SCORE during training with GPU -0 configuration and fill-config CPU settings #13442
Unanswered
dmesquita
asked this question in
Help: Coding & Implementations
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hi everyone!
This is the context:
When using
init fill-configwithout specifying thelearn_rate, it fills in the training settings for CPU (I still need to look into this further, but from what I've seen in the code, I believe this is the case). When training a pipeline with thetextcatcomponent using--gpu-id -0and this configuration, no error is generated; however, theCATS_SCOREandSCOREremain frozen at eacheval_step.Initially, I thought about creating a pull request with a way to specify CPU or GPU in the
init-configcommand, but it would involve many changes. Then I thought it might be better to check this in thedebug configand raise the error, but at the validation stage, we still don't know if the user is trying to train using--gpu-id -0and a CPU configuration.What do you recommend I propose to solve this problem? Actually, before that: is it worth solving this, or is it a rare use case? Thank you!
Beta Was this translation helpful? Give feedback.
All reactions