orthogonalized-optimizers.md

.. role:: hidden
    :class: hidden-section

emerging_optimizers.orthogonalized_optimizers
=============================================

.. automodule:: emerging_optimizers.orthogonalized_optimizers
.. currentmodule:: emerging_optimizers.orthogonalized_optimizers

:hidden:`OrthogonalizedOptimizer`
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

.. autoclass:: OrthogonalizedOptimizer
    :members:

:hidden:`Muon`
~~~~~~~~~~~~~~~

.. autoclass:: Muon
    :members:


:hidden:`Scion`
~~~~~~~~~~~~~~~

.. autoclass:: Scion
    :members:

:hidden:`MOP`
~~~~~~~~~~~~~~~

.. autoclass:: MOP
    :members:

:hidden:`MuonHyperball`
~~~~~~~~~~~~~~~~~~~~~~~

.. autoclass:: MuonHyperball
    :members:

:hidden:`Spectron`
~~~~~~~~~~~~~~~~~~~

.. autoclass:: Spectron
    :members:


:hidden:`Newton-Schulz`
~~~~~~~~~~~~~~~~~~~~~~~~
.. automodule:: emerging_optimizers.orthogonalized_optimizers.muon_utils
.. currentmodule:: emerging_optimizers.orthogonalized_optimizers.muon_utils

.. autofunction:: newton_schulz
.. autofunction:: newton_schulz_step
.. autofunction:: newton_schulz_tp