Skip to content

Commit 5d924c5

Browse files
committed
docs: v3.0.1 changelog
1 parent 6675dfe commit 5d924c5

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

docs/changelogs/v3.0.1.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,10 @@
44

55
* Implement `FAdam` optimizer. (#241, #242)
66
* [Adam is a natural gradient optimizer using diagonal empirical Fisher information](https://arxiv.org/abs/2405.12807)
7+
* Tweak `AdaFactor` optimizer. (#236, #243)
8+
* support not-using-first-momentum when beta1 is not given
9+
* default dtype for first momentum to `bfloat16`
10+
* clip second momentum to 0.999
711

812
### Bug
913

0 commit comments

Comments
 (0)