[Feature Request] Add SwiGLU support for Qwen3-VL models #956
Description
🚀 The feature, motivation and pitch
Problem Description
Can we add SwiGLU kernel support for Qwen3-VL models in Liger-Kernel?
Currently, it appears that passing swiglu=True in the apply_liger_kernel_to_qwen3_vl monkey patch function is a no-op and does not activate the kernel.
References
- Original PR: Support for Qwen3-VL models #911
- Relevant Discussion: Comment Link
Alternatives
No response
Additional context
No response