Skip to content

Why is on_before_optimizer_step incompatible with accumulate_grad_batches ? #11331

Discussion options

You must be logged in to vote

hey @NathanGodey !

it doesn't mean that it won't be called if accumulate_grad_batches > 1, but only be called when accumulation is done and it's time to update the gradients with optimizer.step.

Replies: 1 comment 2 replies

Comment options

You must be logged in to vote
2 replies
@NathanGodey
Comment options

@rohitgr7
Comment options

Answer selected by NathanGodey
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment