Skip to content

Commit 96c91e6

Browse files
committed
docs: v3.5.0 changelog
1 parent 671b902 commit 96c91e6

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

docs/changelogs/v3.4.3.md renamed to docs/changelogs/v3.5.0.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,10 @@
55
* Support `StableSPAM` optimizer. (#358, #359)
66
* [How to Train in 4-Bit More Stably than 16-Bit Adam](https://arxiv.org/abs/2502.17055?)
77
* Support `ScheduleFreeWrapper`. (#334, #360)
8+
* Implement `AdaGC` optimizer. (#364, #366)
9+
* [Improving Training Stability for Large Language Model Pretraining](https://arxiv.org/abs/2502.11034)
10+
* Implement `Simplified-Ademamix` optimizer. (#364, #366)
11+
* [Connections between Schedule-Free Optimizers, AdEMAMix, and Accelerated SGD Variants](https://arxiv.org/abs/2502.02431)
812

913
### Update
1014

0 commit comments

Comments
 (0)