ValueError: The following model_kwargs are not used by the model: ['mm_token_type_ids']

[albertvillanova]

A ValueError is raised when training with the latest transformers version (v5.3.0) and liger-kernel for any of the following VL models:

• glm4v
• glm4v_moe
• qwen2_vl
• qwen2_5_vl
• qwen3_vl
• qwen3_vl_moe

The issue appeared after the merge of this PR in transformers:

• 🚨 Unify 3D position ids transformers#43972

I opened an upstream issue and PR to fix this in liger-kernel:

• Qwen2.5-VL lce_forward() missing mm_token_type_ids causes ValueError in model.generate() with transformers > 5.2.0 linkedin/Liger-Kernel#1117
• Add mm_token_type_ids param to VL models lce_forward to fix ValueError linkedin/Liger-Kernel#1120

It is still pending review, approval, merge and release.

See previous related issue:

• CI fails with dev dependencies: ValueError: The following model_kwargs are not used by the model: ['mm_token_type_ids'] #5201

[albertvillanova]

The PR was merged; pending to be released.