Skip to content

Release v0.2.4

Choose a tag to compare

View all tags
@yanghaojin yanghaojin released this 22 May 22:26
· 4 commits to main since this release
v0.2.4
8addc3e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Added

  • Tuned the hyperparameters of DiodeMix optimizer for sft.
  • Added sft-support for the classical gptq-style models.
  • Implemented qzeros update in finetuning process.

Updated

  • Extended pack_fp_weight function.
  • Enhanced the performance of MPQLinearCUDA layer.

Fixed

  • Fixed various errors in DiodeMix update function.
Assets 2
Loading