Skip to content

Commit 6b3dd0e

Browse files
committed
fix: momentum buffer
1 parent 9753eda commit 6b3dd0e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

pytorch_optimizer/optimizer/scion.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -409,7 +409,7 @@ def step(self, closure: CLOSURE = None) -> LOSS:
409409

410410
d.mul_(1.0 - group['momentum']).add_(grad, alpha=group['momentum'])
411411

412-
update = norm.lmo(grad).mul_(group['scale'])
412+
update = norm.lmo(d).mul_(group['scale'])
413413

414414
if group['constraint']:
415415
p.mul_(1.0 - group['lr'])

0 commit comments

Comments
 (0)