Skip to content

Commit 2c12ae8

Browse files
committed
refactor: bias_correction1
1 parent 7bcce48 commit 2c12ae8

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

pytorch_optimizer/adabelief.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -193,9 +193,8 @@ def step(self, closure: CLOSURE = None) -> LOSS:
193193
step_size = rt
194194
else:
195195
step_size = rt / bias_correction1
196-
197196
elif self.degenerated_to_sgd:
198-
step_size = 1.0 / (1.0 - beta1 ** state['step'])
197+
step_size = 1.0 / bias_correction1
199198
else:
200199
step_size = -1
201200

0 commit comments

Comments
 (0)