Skip to content

Commit 9865c97

Browse files
committed
docs: README
1 parent e694f0b commit 9865c97

File tree

2 files changed

+8
-0
lines changed

2 files changed

+8
-0
lines changed

README.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -373,6 +373,10 @@ Correcting the norm of a gradient in each iteration based on the adaptive traini
373373

374374
Updates only occur when the proposed update direction aligns with the current gradient.
375375

376+
### Adam-ATAN2
377+
378+
Adam-atan2 is a new numerically stable, scale-invariant version of Adam that eliminates the epsilon hyperparameter.
379+
376380
## Frequently asked questions
377381

378382
[here](docs/qa.md)

docs/index.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -373,6 +373,10 @@ Correcting the norm of a gradient in each iteration based on the adaptive traini
373373

374374
Updates only occur when the proposed update direction aligns with the current gradient.
375375

376+
### Adam-ATAN2
377+
378+
Adam-atan2 is a new numerically stable, scale-invariant version of Adam that eliminates the epsilon hyperparameter.
379+
376380
## Frequently asked questions
377381

378382
[here](docs/qa.md)

0 commit comments

Comments
 (0)