Cannot log gpu memory without making on step = True while logging train loss

[karthi0804]

I am using 1.3.0 version. I wanted to just log the gpu memory at all time steps. So I enabled log_gpu_memory='all' and log_every_n_steps=1. I couldn't find the gpu logging for steps. But If I log the train loss on steps, I can see the gpu logging at each steps. Is this how it is intended to work? I expect that gpu logging should be independent of self.log().