v0.1.4

[Luosuu]

Highlights

• We now have GPU and NPU in CI and enable some tests on them. We call for more contribution of tests if you are interested!
• Now VeOmni model/dataset/dataloader/checkpointer/chat_template/preprocess are registry-based, making adding new of them and customization more easily
• Update pyproject.toml for uv-based env management. We now only suggest you to install veomni through uv.

What's Changed

• update README.md by @Fazziekey in update README.md #188
• [dist] fix: refactor fsdp2 grad norm clipping by @Luosuu in [dist] fix: refactor fsdp2 grad norm clipping #185
• [misc] fix: reset hf init flag for random init by @Luosuu in [misc] fix: reset hf init flag for random init #176
• Fix Qwen3-Moe MFU by @zhihaofang1017 in Fix Qwen3-Moe MFU #125
• [model] fix:avoid cpu-device sync for qwenvl on npu by @wey-code in [model] fix:avoid cpu-device sync for qwenvl on npu #190
• [task] fix: replace DataArguments with MyDataArguments and remove duplicated step2token saving by @MuyaoLi-jimo in [task] fix: replace DataArguments with MyDataArguments and remove duplicated step2token saving #189
• [ci] test: CI env test by @FoolPlayer in [ci] test: CI env test #201
• [ckpt][fix]release cuda mem after dcp sync save by @EricOlivier in [ckpt][fix]release cuda mem after dcp sync save #207
• [misc] feat: update uv support for aarch platform for Ascend+Kunpeng … by @pjgao in [misc] feat: update uv support for aarch platform for Ascend+Kunpeng … #148
• [data] fix: fix exception raised when fetching current_device on NPU by @ji-huazhong in [data] fix: fix exception raised when fetching current_device on NPU #211
• [ci] test: fix data_ci by @Coach257 in [ci] test: fix data_ci #222
• [ci] test: add npu ci env by @FoolPlayer in [ci] test: add npu ci env #219
• title: [data] feat: Implement extensible data preprocessor registry by @TimYangst in title: [data] feat: Implement extensible data preprocessor registry #203
• [ci]Add NPU support to data and model test by @Crystal-jiang in [ci]Add NPU support to data and model test #224
• [ci]Add Ascend NPU native support to the unit test code by @Crystal-jiang in [ci]Add Ascend NPU native support to the unit test code #208
• [ci] chore: add gemini config & test by @FoolPlayer in [ci] chore: add gemini config & test #229
• [test] ci: add device api check for tests by @onehaitao in [test] ci: add device api check for tests #213
• [core] feat: registry for dataset & dataloader & checkpointer & ckpt_to_state_dict & chat_template & preprocess by @Coach257 in [core] feat: registry for dataset & dataloader & checkpointer & ckpt_to_state_dict & chat_template & preprocess #230
• [dist] fix: make OptimizerState EP-dim aware to fix its dcp saving by @Luosuu in [dist] fix: make OptimizerState EP-dim aware to fix its dcp saving #228
• Automatically add the "ascend" label by @Crystal-jiang in Automatically add the "ascend" label #234
• [helper]:fix npu profiling by @Feng0w0 in [helper]:fix npu profiling #214
• helper: degrade veomni_patch functions to warnings/no-op by @iqiancheng in helper: degrade veomni_patch functions to warnings/no-op #197
• [ci] fix: dataloader in e2e ckpt test by @Luosuu in [ci] fix: dataloader in e2e ckpt test #233
• [feat] nccl_timeout by @brook-cpp in [feat] nccl_timeout #217
• Automatically apply "ascend" label to issues and PRs by @Crystal-jiang in Automatically apply "ascend" label to issues and PRs #239
• chore: Upgrade PyTorch dependencies to 2.8.0 and flash-attention to 2.8.3 by @TimYangst in chore: Upgrade PyTorch dependencies to 2.8.0 and flash-attention to 2.8.3 #242
• [version] update transformers version to 4.57.0 by @phdddd in [version] update transformers version to 4.57.0 #243
• feat: distributed checkpointer support customized backend by @Ziyi-Wang in feat: distributed checkpointer support customized backend #182
• [ckpt] refactor: remove unused output_dir parameter from ckpt_to_state_dict by @TimYangst in [ckpt] refactor: remove unused output_dir parameter from ckpt_to_state_dict #248
• [config, omni, dis] fix: quick fix for sft of Wan2.1-I2V-14B-480P by @zbian99 in [config, omni, dis] fix: quick fix for sft of Wan2.1-I2V-14B-480P #240
• [model] fix: Update @check_model_inputs decorator for transformers 4.57+ compatibility by @TimYangst in [model] fix: Update @check_model_inputs decorator for transformers 4.57+ compatibility #252
• [core] fix is_x_backend by @brook-cpp in [core] fix is_x_backend #251
• [data] fix: quick fix for exception raised when building dit dataloader on NPU by @zbian99 in [data] fix: quick fix for exception raised when building dit dataloader on NPU #246
• upgrade: Upgrade transformers from v4.57.0 to v4.57.3 by @yiwzhao in upgrade: Upgrade transformers from v4.57.0 to v4.57.3 #249
• [core] feat: model registry by @Coach257 in [core] feat: model registry #258
• [dist] feat: unified veomni grad norm clipping by @Luosuu in [dist] feat: unified veomni grad norm clipping  #205
• [task]fix: fix train.sh NPROC_PER_NODE calculation logic on the NPU by @Crystal-jiang in [task]fix: fix train.sh NPROC_PER_NODE calculation logic on the NPU #227
• [chore]: cache ep group by @heidongxianhua in [chore]: cache ep group #231

New Contributors

• @zhihaofang1017 made their first contribution in Fix Qwen3-Moe MFU #125
• @MuyaoLi-jimo made their first contribution in [task] fix: replace DataArguments with MyDataArguments and remove duplicated step2token saving #189
• @FoolPlayer made their first contribution in [ci] test: CI env test #201
• @EricOlivier made their first contribution in [ckpt][fix]release cuda mem after dcp sync save #207
• @pjgao made their first contribution in [misc] feat: update uv support for aarch platform for Ascend+Kunpeng … #148
• @ji-huazhong made their first contribution in [data] fix: fix exception raised when fetching current_device on NPU #211
• @TimYangst made their first contribution in title: [data] feat: Implement extensible data preprocessor registry #203
• @Crystal-jiang made their first contribution in [ci]Add NPU support to data and model test #224
• @onehaitao made their first contribution in [test] ci: add device api check for tests #213
• @Feng0w0 made their first contribution in [helper]:fix npu profiling #214
• @iqiancheng made their first contribution in helper: degrade veomni_patch functions to warnings/no-op #197
• @brook-cpp made their first contribution in [feat] nccl_timeout #217
• @phdddd made their first contribution in [version] update transformers version to 4.57.0 #243
• @zbian99 made their first contribution in [config, omni, dis] fix: quick fix for sft of Wan2.1-I2V-14B-480P #240
• @yiwzhao made their first contribution in upgrade: Upgrade transformers from v4.57.0 to v4.57.3 #249

Full Changelog: v0.1.3...v0.1.4

---

This discussion was created from the release v0.1.4.