Skip to content

pytorch-optimizer v0.0.5

Choose a tag to compare

View all tags
@kozistr kozistr released this 22 Sep 07:42
v0.0.5
3c7a89f
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
  • Combine AdaBoundW into AdaBound optimizer with weight_decouple parameter.
  • Implement AdaBelief optimizer
    • Support fp16
    • Support weight_decouple with AdamW scheme
    • Support rectified update similar to RAdam
Assets 2
Loading