-
Notifications
You must be signed in to change notification settings - Fork 3.6k
Open
Labels
Description
Description & Motivation
Today on_validation_model_train/eval (similar to on_test_xxx) is only available in LightningModule. It would be helpful to open up this interface to callback as well especially as callbacks are much more pluggable. This will be very helpful for implementing ScheduleFree optimizers which has been proved to be very convergence efficient: https://github.com/facebookresearch/schedule_free/tree/main/schedulefree
I'd be happy to draft a PR if this idea is approved.
Pitch
Add on_validation_model_train/eval (and those for test) to callback API
Alternatives
No response
Additional context
No response