save new LR with save_hyperparameters after lr_find

[Shualdon]

Hi,

I'm tuning the initial LR using lr_find, and I want to save the new LR hyperparameter using save_hyeperparameters. Right now I have the save_hyeperparameters in the init function with some default LR I pass to the model. I do see it saves the passed value to the hparam file, but it doesn't update the value after I find a better value. I use model.hparams.lr = lr_finder.suggestion() to update the LR in the model, as well as update_attr=True in the lr_tune function - just for good measure...

Is there a way to save the new value? Calling save_hyeperparameters outside of the init function gives an error.