Comet ML Logger with ddp

[FrancescoSaverioZuppichini]

Hi Guys,

Is there a way to correctly log with comet with the ddp accelerator? I am not able to average the loss between GPUs

Thanks,

Francesco

[tchaton]

Dear @FrancescoSaverioZuppichini,

The loss should be atomically reduced on epoch end across batches and processes. Mind sharing a snippet of code ?

Best,
T.C