We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 71f226c commit b5b16adCopy full SHA for b5b16ad
docs/changelogs/v3.3.5.md
@@ -1,8 +1,19 @@
1
### Change Log
2
3
+### Feature
4
+
5
+* Implement `FOCUS` optimizer. (#330, #331)
6
+ * [First Order Concentrated Updating Scheme](https://arxiv.org/abs/2501.12243)
7
8
+### Update
9
10
+* Support `OrthoGrad` variant to `Ranger25`. (#332)
11
12
### Fix
13
14
* Add the missing `state` property in `OrthoGrad` optimizer. (#326, #327)
15
+* Add the missing `state_dict`, and `load_state_dict` methods to `TRAC` and `OrthoGrad` optimizers. (#332)
16
+* Skip when the gradient is sparse in `OrthoGrad` optimizer. (#332)
17
18
### Contributions
19
0 commit comments