Is compute() in DDP always called exclusively on rank zero?

[astrocyted]

I'm trying to wrap my metric using the torchmetrics metric class and I just wanted to make sure if the compute is performed only on a single process (rank_zero) when in DDP mode and after gathering. Of course it doesnt make any sense to do it across all processes being extremely redundant but i ask because i couldn't find explicitly in the code that compute is restricted to a single process. Thanks for clarifying.