Skip to content

Question about the log system #11670

Jan 31, 2022 · 1 comments · 4 replies
Discussion options

You must be logged in to vote

hey @exiawsh

it should stay as batch_size for a single device only. With DDP if you set batch_size=7, then each device gets the batch of batch_size=7, and effective batch_size increases with the number of devices. Now if you want to log by accumulating metrics across devices, you need to set sync_dist=True. Check out the section here: https://pytorch-lightning.readthedocs.io/en/latest/extensions/logging.html#automatic-logging

Replies: 1 comment 4 replies

Comment options

You must be logged in to vote
4 replies
@exiawsh
Comment options

@rohitgr7
Comment options

@rohitgr7
Comment options

@exiawsh
Comment options

Answer selected by exiawsh
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment