File tree Expand file tree Collapse file tree 4 files changed +41
-14
lines changed
Expand file tree Collapse file tree 4 files changed +41
-14
lines changed Original file line number Diff line number Diff line change @@ -8,4 +8,6 @@ NeMo Emerging Optimizers API reference provides comprehensive technical document
88
99utils.md
1010orthogonalized-optimizers.md
11+ soap.md
12+ scalar-optimizers.md
1113```
Original file line number Diff line number Diff line change 1+ ``` {eval-rst}
2+ .. role:: hidden
3+ :class: hidden-section
4+
5+ emerging_optimizers.scalar_optimizers
6+ =====================================
7+
8+ .. automodule:: emerging_optimizers.scalar_optimizers
9+ :members:
10+ ```
Original file line number Diff line number Diff line change 1+ ``` {eval-rst}
2+ .. role:: hidden
3+ :class: hidden-section
4+
5+ emerging_optimizers.soap
6+ ===================================
7+
8+ .. automodule:: emerging_optimizers.soap.soap
9+ .. currentmodule:: emerging_optimizers.soap.soap
10+
11+ :hidden:`SOAP`
12+ ~~~~~~~~~~~~~~~
13+
14+ .. autoclass:: SOAP
15+ :members:
16+
17+ .. autofunction:: precondition
18+
19+ .. autofunction:: init_kronecker_factors
20+
21+ .. autofunction:: update_kronecker_factors
22+
23+ .. autofunction:: update_eigenbasis_and_momentum
24+ ```
Original file line number Diff line number Diff line change @@ -7,20 +7,11 @@ emerging_optimizers.utils
77==========================
88
99.. automodule:: emerging_optimizers.utils
10- .. currentmodule:: emerging_optimizers.utils
10+ :members:
1111
12- :hidden:`fp32_matmul_precision`
13- ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1412
15- .. autofunction:: fp32_matmul_precision
16-
17- :hidden:`get_pg_size`
18- ~~~~~~~~~~~~~~~~~~~~~
19-
20- .. autofunction:: get_pg_size
21-
22- :hidden:`get_pg_rank`
23- ~~~~~~~~~~~~~~~~~~~~~
24-
25- .. autofunction:: get_pg_rank
13+ emerging_optimizers.utils.eig
14+ =============================
15+ .. automodule:: emerging_optimizers.utils.eig
16+ :members:
2617```
You can’t perform that action at this time.
0 commit comments