How to do evaluation while training? #2944
-
|
How can I do custom evaluation while training, like, calculating acc\f1 for a certain downstream task? |
Beta Was this translation helpful? Give feedback.
Answered by
NanoCode012
Jul 18, 2025
Replies: 1 comment
-
|
Hey, we answered that here #2336 . Alternative is to add via callback (for example: https://github.com/axolotl-ai-cloud/axolotl/pull/1917/files#diff-1d38788973807de494b0047087ed81a85801f23ba9b1f67a836fa2673385c5cd ) |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
CopyNinja1999
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hey, we answered that here #2336 . Alternative is to add via callback (for example: https://github.com/axolotl-ai-cloud/axolotl/pull/1917/files#diff-1d38788973807de494b0047087ed81a85801f23ba9b1f67a836fa2673385c5cd )