OpenCL: MoE MXFP4 kernel optimizations #16037

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

lhez merged 15 commits into ggml-org:master from CodeLinaro:moe-mxfp4-opt-1

Sep 18, 2025

ggml/src/ggml-opencl/CMakeLists.txt

-Original file line number
+Diff line change
@@ Expand Up / @@ -83,8 +83,10 @@ set(GGML_OPENCL_KERNELS @@
         mul_mv_q4_0_f32_1d_16x_flat
         mul_mv_q6_k
         mul_mv_mxfp4_f32
+        mul_mv_mxfp4_f32_flat
         mul_mv_id_q4_0_f32_8x_flat
         mul_mv_id_mxfp4_f32
+        mul_mv_id_mxfp4_f32_flat
         mul_mm_f32_f32_l4_lm
         mul_mm_f16_f32_l4_lm
         mul
@@ Expand Down @@