Skip to content

Commit 89f37e7

Browse files
Update emerging_optimizers/orthogonalized_optimizers/muon.py
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Signed-off-by: Hao Wu <[email protected]>
1 parent c5217db commit 89f37e7

File tree

1 file changed

+1
-1
lines changed
  • emerging_optimizers/orthogonalized_optimizers

1 file changed

+1
-1
lines changed

emerging_optimizers/orthogonalized_optimizers/muon.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -61,7 +61,7 @@ class Muon(OrthogonalizedOptimizer):
6161
["simple", "quintic", "polar_express"].
6262
num_ns_steps: The number of iteration steps to use in the Newton-Schulz iteration.
6363
scale_mode: The type of scale factor to use for the update. Defaults to "spectral" style scaling.
64-
extra_scale_factor: The additional scale factor to use for the update. Set it to 0.2 can closely match
64+
extra_scale_factor: The additional scale factor to use for the update. Setting it to 0.2 can closely match
6565
the update RMS norm of AdamW as suggested by https://arxiv.org/abs/2502.16982.
6666
use_syrk: Whether to use the Triton kernel for the Newton-Schulz iteration.
6767
"""

0 commit comments

Comments
 (0)