File tree Expand file tree Collapse file tree 2 files changed +3
-2
lines changed
examples/vlm_finetune/kimi Expand file tree Collapse file tree 2 files changed +3
-2
lines changed Original file line number Diff line number Diff line change @@ -25,6 +25,7 @@ NeMo Automodel supports [AutoModelForImageTextToText](https://huggingface.co/doc
2525
2626| Model | Dataset | FSDP2 | PEFT | Example YAML |
2727| ------------------------------------| -----------------------------| ------------| ------------| --------------|
28+ | Kimi-VL-A3B-Instruct | cord-v2 | Supported | Supported | [ kimi2vl_cordv2.yaml] ( ../../examples/vlm_finetune/kimi/kimi2vl_cordv2.yaml ) |
2829| Gemma 3-4B & 27B | naver-clova-ix & rdr-items | Supported | Supported | [ gemma3_vl_4b_cord_v2.yaml] ( ../../examples/vlm_finetune/gemma3/gemma3_vl_4b_cord_v2.yaml ) |
2930| Gemma 3n | naver-clova-ix & rdr-items | Supported | Supported | [ gemma3n_vl_4b_medpix.yaml] ( ../../examples/vlm_finetune/gemma3n/gemma3n_vl_4b_medpix.yaml ) |
3031| Qwen2-VL-2B-Instruct & Qwen2.5-VL-3B-Instruct | cord-v2 | Supported | Supported | [ qwen2_5_vl_3b_rdr.yaml] ( ../../examples/vlm_finetune/qwen2_5/qwen2_5_vl_3b_rdr.yaml ) |
Original file line number Diff line number Diff line change 4949 backend :
5050 _target_ : nemo_automodel.components.models.common.BackendConfig
5151 attn : te
52- linear : torch
53- rms_norm : torch
52+ linear : te
53+ rms_norm : te
5454 rope_fusion : true
5555 enable_deepep : true
5656 fake_balanced_gate : false
You can’t perform that action at this time.
0 commit comments