Skip to content

Commit 44893a5

Browse files
committed
update: default preconditioning_compute_steps to 1000
1 parent 1da994d commit 44893a5

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

pytorch_optimizer/optimizer/shampoo.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -190,7 +190,7 @@ def __init__(
190190
decoupled_learning_rate: bool = True,
191191
inverse_exponent_override: int = 0,
192192
start_preconditioning_step: int = 25,
193-
preconditioning_compute_steps: int = 1,
193+
preconditioning_compute_steps: int = 1000,
194194
statistics_compute_steps: int = 1,
195195
block_size: int = 256,
196196
skip_preconditioning_rank_lt: int = 1,

0 commit comments

Comments
 (0)