We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 2a208d1 commit 2b0809bCopy full SHA for 2b0809b
docs/changelogs/v3.4.1.md
@@ -15,7 +15,16 @@
15
* `AGC` + `Lookahead` variants
16
* change default beta1, beta2 to 0.95 and 0.98 respectively
17
* Skip adding `Lookahead` wrapper in case of `Ranger*` optimizers, which already have it in `create_optimizer()`. (#340)
18
+* Improved optimizer visualization. (#345)
19
+
20
+### Bug
21
22
+* Fix to update exp_avg_sq after calculating the denominator in `ADOPT` optimizer. (#346, #347)
23
24
### Docs
25
26
* Update the visualizations. (#340)
27
28
+### Contributions
29
30
+thanks to @AidinHamedi
0 commit comments