Skip to content

Commit 38419ae

Browse files
committed
docs: v3.3.0 changelog
1 parent aee5fc4 commit 38419ae

File tree

1 file changed

+8
-0
lines changed

1 file changed

+8
-0
lines changed

docs/changelogs/v3.3.0.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,14 @@
1414
* Improve the stability of `ADOPT` optimizer. (#294)
1515
* [Note](https://github.com/iShohei220/adopt?tab=readme-ov-file#update-on-nov-22-2024)
1616
* Support a new projection type `random` for `GaLoreProjector`. (#294)
17+
* Implement `DeMo` optimizer. (#300, #301)
18+
* [Decoupled Momentum Optimization](https://arxiv.org/abs/2411.19870)
19+
* Implement `Muon` optimizer. (#302)
20+
* [MomentUm Orthogonalized by Newton-schulz](https://github.com/KellerJordan/Muon)
21+
* Implement `ScheduleFreeRAdam` optimizer. (#304)
22+
* Implement `LaProp` optimizer. (#304)
23+
* [Separating Momentum and Adaptivity in Adam](https://arxiv.org/abs/2002.04839)
24+
* Support `Cautious` variant to `LaProp`, `AdamP`, `Adopt` optimizers. (#304).
1725

1826
### Refactor
1927

0 commit comments

Comments
 (0)