Skip to content

Commit e5a78dd

Browse files
committed
Remove redundant Optimizers Included section
Signed-off-by: Santosh Bhavani <[email protected]>
1 parent 6375bcf commit e5a78dd

File tree

1 file changed

+0
-9
lines changed

1 file changed

+0
-9
lines changed

README.md

Lines changed: 0 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -22,15 +22,6 @@ Emerging optimizers have demonstrated significant practical impact in large-scal
2222
- Improve final model quality through better conditioning of the optimization landscape
2323
- Enable more efficient hyperparameter tuning due to reduced sensitivity to learning rates
2424

25-
### Optimizers Included
26-
27-
This project currently includes the following optimizers:
28-
29-
- **Shampoo**: Uses Kronecker-factored preconditioning ([arXiv:1802.09568](https://arxiv.org/abs/1802.09568))
30-
- **SOAP (Shampoo with Adam in the Preconditioner)**: Combines Shampoo's preconditioning with Adam-style momentum ([arXiv:2409.11321](https://arxiv.org/abs/2409.11321))
31-
- **Muon**: Uses Newton-Schulz orthogonalization for improved stability and convergence in large-scale training ([arXiv:2502.16982](https://arxiv.org/abs/2502.16982))
32-
33-
3425
## Installation
3526

3627
### Prerequisites

0 commit comments

Comments
 (0)