Will validation_step use torch.no_grad? #9728

morestart started this conversation in General

morestart
Sep 28, 2021

I want know will validation_step use torch.no_grad to eval model or just use model.eval()?

Replies: 1 comment 1 reply

ananthsub
Sep 28, 2021

yes, no_grad is automatically applied around the validation loop: https://github.com/PyTorchLightning/pytorch-lightning/blob/131176b9f5e544a1133240a46dca1960308b7849/pytorch_lightning/trainer/trainer.py#L1195-L1196

https://github.com/PyTorchLightning/pytorch-lightning/blob/131176b9f5e544a1133240a46dca1960308b7849/pytorch_lightning/loops/epoch/training_epoch_loop.py#L254-L255

1 reply

morestart Sep 28, 2021
Author

oh, thanks for your help~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment