Skip to content

Commit e40fce8

Browse files
authored
Add document for soap (#21)
* add document for soap Signed-off-by: Hao Wu <[email protected]>
1 parent 5889b64 commit e40fce8

File tree

4 files changed

+41
-14
lines changed

4 files changed

+41
-14
lines changed

docs/apidocs/index.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,4 +8,6 @@ NeMo Emerging Optimizers API reference provides comprehensive technical document
88
99
utils.md
1010
orthogonalized-optimizers.md
11+
soap.md
12+
scalar-optimizers.md
1113
```

docs/apidocs/scalar-optimizers.md

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
```{eval-rst}
2+
.. role:: hidden
3+
:class: hidden-section
4+
5+
emerging_optimizers.scalar_optimizers
6+
=====================================
7+
8+
.. automodule:: emerging_optimizers.scalar_optimizers
9+
:members:
10+
```

docs/apidocs/soap.md

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,24 @@
1+
```{eval-rst}
2+
.. role:: hidden
3+
:class: hidden-section
4+
5+
emerging_optimizers.soap
6+
===================================
7+
8+
.. automodule:: emerging_optimizers.soap.soap
9+
.. currentmodule:: emerging_optimizers.soap.soap
10+
11+
:hidden:`SOAP`
12+
~~~~~~~~~~~~~~~
13+
14+
.. autoclass:: SOAP
15+
:members:
16+
17+
.. autofunction:: precondition
18+
19+
.. autofunction:: init_kronecker_factors
20+
21+
.. autofunction:: update_kronecker_factors
22+
23+
.. autofunction:: update_eigenbasis_and_momentum
24+
```

docs/apidocs/utils.md

Lines changed: 5 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -7,20 +7,11 @@ emerging_optimizers.utils
77
==========================
88
99
.. automodule:: emerging_optimizers.utils
10-
.. currentmodule:: emerging_optimizers.utils
10+
:members:
1111
12-
:hidden:`fp32_matmul_precision`
13-
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1412
15-
.. autofunction:: fp32_matmul_precision
16-
17-
:hidden:`get_pg_size`
18-
~~~~~~~~~~~~~~~~~~~~~
19-
20-
.. autofunction:: get_pg_size
21-
22-
:hidden:`get_pg_rank`
23-
~~~~~~~~~~~~~~~~~~~~~
24-
25-
.. autofunction:: get_pg_rank
13+
emerging_optimizers.utils.eig
14+
=============================
15+
.. automodule:: emerging_optimizers.utils.eig
16+
:members:
2617
```

0 commit comments

Comments
 (0)