File tree Expand file tree Collapse file tree 2 files changed +8
-0
lines changed Expand file tree Collapse file tree 2 files changed +8
-0
lines changed Original file line number Diff line number Diff line change @@ -373,6 +373,10 @@ Correcting the norm of a gradient in each iteration based on the adaptive traini
373373
374374Updates only occur when the proposed update direction aligns with the current gradient.
375375
376+ ### Adam-ATAN2
377+
378+ Adam-atan2 is a new numerically stable, scale-invariant version of Adam that eliminates the epsilon hyperparameter.
379+
376380## Frequently asked questions
377381
378382[ here] ( docs/qa.md )
Original file line number Diff line number Diff line change @@ -373,6 +373,10 @@ Correcting the norm of a gradient in each iteration based on the adaptive traini
373373
374374Updates only occur when the proposed update direction aligns with the current gradient.
375375
376+ ### Adam-ATAN2
377+
378+ Adam-atan2 is a new numerically stable, scale-invariant version of Adam that eliminates the epsilon hyperparameter.
379+
376380## Frequently asked questions
377381
378382[ here] ( docs/qa.md )
You can’t perform that action at this time.
0 commit comments