Skip to content

Commit 64b84dc

Browse files
authored
Merge pull request #184 from kozistr/docs/readme
[Docs] README
2 parents baa65c4 + efebbab commit 64b84dc

File tree

1 file changed

+4
-6
lines changed

1 file changed

+4
-6
lines changed

README.rst

Lines changed: 4 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -212,8 +212,6 @@ You can check the supported optimizers with below code.
212212
+--------------+---------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
213213
| SignSGD | *Compressed Optimisation for Non-Convex Problems* | `github <https://github.com/jxbz/signSGD>`__ | `https://arxiv.org/abs/1802.04434 <https://arxiv.org/abs/1802.04434>`__ | `cite <https://ui.adsabs.harvard.edu/abs/2018arXiv180204434B/exportcitation>`__ |
214214
+--------------+---------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
215-
| AdaHessian | *An Adaptive Second Order Optimizer for Machine Learning* | `github <https://github.com/amirgholami/adahessian>`__ | `https://arxiv.org/abs/2006.00719 <https://arxiv.org/abs/2006.00719>`__ | `cite <https://github.com/amirgholami/adahessian#citation>`__ |
216-
+--------------+---------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
217215
| Sophia | *A Scalable Stochastic Second-order Optimizer for Language Model Pre-training* | `github <https://github.com/Liuhong99/Sophia>`__ | `https://arxiv.org/abs/2305.14342 <https://arxiv.org/abs/2305.14342>`__ | `cite <https://github.com/Liuhong99/Sophia>`__ |
218216
+--------------+---------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
219217
| Prodigy | *An Expeditiously Adaptive Parameter-Free Learner* | `github <https://github.com/konstmish/prodigy>`__ | `https://arxiv.org/abs/2306.06101 <https://arxiv.org/abs/2306.06101>`__ | `cite <https://github.com/konstmish/prodigy#how-to-cite>`__ |
@@ -372,8 +370,8 @@ Adaptive Gradient Norm Correction
372370
Citation
373371
--------
374372

375-
Please cite original authors of optimization algorithms. If you use this software, please cite it as below.
376-
Or you can get from "cite this repository" button.
373+
Please cite original authors of optimization algorithms. You can easily find it from the above table!
374+
If you use this software, please cite it as below. Or you can get from "cite this repository" button.
377375

378376
::
379377

@@ -385,8 +383,8 @@ Or you can get from "cite this repository" button.
385383
year = {2022}
386384
}
387385

388-
Author
389-
------
386+
Maintainer
387+
----------
390388

391389
Hyeongchan Kim / `@kozistr <http://kozistr.tech/about>`__
392390

0 commit comments

Comments
 (0)