Skip to content

pytorch-optimizer v2.0.0

Choose a tag to compare

View all tags
@kozistr kozistr released this 21 Oct 01:35
v2.0.0
c6d64ef
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Chage Log

  • Refactor the package depth
    • 4 depths
      • pytorch_optimizer.lr_scheduler : lr schedulers
      • pytorch_optimizer.optimizer : optimizers
      • pytorch_optimizer.base : base utils
      • pytorch_optimizer.experimental : any experimental features
    • pytorch_optimizer.adamp -> pytorch_optimizer.optimizer.adamp
    • Still from pytorch_optimizer import AdamP is possible
  • Implement lr schedulers
    • CosineAnealingWarmupRestarts
  • Implement (experimental) lr schedulers
    • DeBERTaV3-large layer-wise lr scheduler

Other changes (bug fixes, small refactors)

  • Fix AGC (to returning the parameter)
  • Make a room for experimental features (at pytorch_optimizer.experimental)
  • base types
Assets 2
Loading