Skip to content

Commit 3b56b70

Browse files
committed
docs: v3.0.1 changelog
1 parent e3398c7 commit 3b56b70

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

docs/changelogs/v3.0.1.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,8 @@
88
* support not-using-first-momentum when beta1 is not given
99
* default dtype for first momentum to `bfloat16`
1010
* clip second momentum to 0.999
11+
* Implement `GrokFast` optimizer. (#244, #245)
12+
* [Accelerated Grokking by Amplifying Slow Gradients](https://arxiv.org/abs/2405.20233)
1113

1214
### Bug
1315

0 commit comments

Comments
 (0)