Skip to content

Commit 18a5fda

Browse files
committed
fix: Ranger21
1 parent 5f68bcf commit 18a5fda

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

pytorch_optimizer/ranger21.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -237,8 +237,8 @@ def step(self, closure: CLOSURE = None) -> LOSS:
237237

238238
# Phase 2 - Apply weight decay and step
239239
for group in self.param_groups:
240-
step = group['step']
241240
lr = group['lr']
241+
step = self.state[group['params'][0]]['step']
242242

243243
# warm up
244244
lr = self.warm_up_dampening(lr, step)

0 commit comments

Comments
 (0)