We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 8bd1f91 commit bd9e1e6Copy full SHA for bd9e1e6
docs/changelogs/v3.5.2.md
@@ -4,6 +4,8 @@
4
5
* Implement `Fira` optimizer. (#376)
6
* [Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?](https://arxiv.org/abs/2410.01623)
7
+* Implement `RACS` and `Alice optimizer. (#376)
8
+ * [Towards Efficient Optimizer Design for LLM via Structured Fisher Approximation with a Low-Rank Extension](https://arxiv.org/abs/2502.07752)
9
10
### Fix
11
0 commit comments