Skip to content

Commit 9a2e427

Browse files
committed
fix: alpha to value
1 parent e8e795d commit 9a2e427

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

pytorch_optimizer/optimizer/adams.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -148,6 +148,6 @@ def step(self, closure: CLOSURE = None) -> LOSS:
148148
de_nom = exp_avg_sq_hat.sqrt().add(group['eps'])
149149

150150
step_size = group['lr'] if self.adamd_debias_term else group['lr'] / bias_correction1
151-
p.addcdiv_(exp_avg, de_nom, alpha=-step_size)
151+
p.addcdiv_(exp_avg, de_nom, value=-step_size)
152152

153153
return loss

0 commit comments

Comments
 (0)