pytorch-optimizer v2.3.1

Change Log

Feature

• more add-ons for Shampoo optimizer, #99
  • implement moving_average_for_momentum
  • implement decoupled_weight_decay
  • implement decoupled_learning_rate
  • supports more grafting (RMSProp, SQRT_N)
  • supports more PreConditioner (ALL, INPUT)

Docs

• apply pydocstyle linter, #91

Refactor

• deberta_v3_large_lr_scheduler, #91

ETC

• add more Ruff rules (ICN, TID, ERA, RUF, YTT, PL), #91