Skip to content

Commit 23adc86

Browse files
committed
docs: v3.2.0 changelog
1 parent e83c789 commit 23adc86

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

docs/changelogs/v3.2.0.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,12 @@
88
* `bnb_ademamix8bit`, `bnb_ademamix32bit`, `bnb_paged_ademamix8bit`, `bnb_paged_ademamix32bit`
99
* Support 8/4bit, fp8 optimizers. (#208, #281)
1010
* `torchao_adamw8bit`, `torchao_adamw4bit`, `torchao_adamwfp8`.
11+
* Support a module-name-level (e.g. `LayerNorm`) weight decay exclusion for `get_optimizer_parameters`. (#282, #283)
1112

1213
### Bug
1314

1415
* Fix `should_grokfast` condition when initialization. (#279, #280)
16+
17+
### Contributions
18+
19+
thanks to @Vectorrent

0 commit comments

Comments
 (0)