Skip to content

feat: sync llama.cpp to b8062#295

Open
a-ghorbani wants to merge 1 commit intomybigday:mainfrom
a-ghorbani:fix/opencl-new-kernels
Open

feat: sync llama.cpp to b8062#295
a-ghorbani wants to merge 1 commit intomybigday:mainfrom
a-ghorbani:fix/opencl-new-kernels

Conversation

@a-ghorbani
Copy link
Collaborator

  • Add new OpenCL kernels: mul_mv_q4_1_f32, mul_mv_q4_1_f32_flat, mul_mv_q4_k_f32, mul_mm_q4_0_f32_l4_lm, mul_mm_q4_1_f32_l4_lm, mul_mm_q6_k_f32_l4_lm
  • Add simd-gemm.h to bootstrap copy list
  • Update Android CMakeLists.txt with new kernel entries

- Add new OpenCL kernels: mul_mv_q4_1_f32, mul_mv_q4_1_f32_flat,
  mul_mv_q4_k_f32, mul_mm_q4_0_f32_l4_lm, mul_mm_q4_1_f32_l4_lm,
  mul_mm_q6_k_f32_l4_lm
- Add simd-gemm.h to bootstrap copy list
- Update Android CMakeLists.txt with new kernel entries
@a-ghorbani a-ghorbani marked this pull request as ready for review February 15, 2026 16:51
@a-ghorbani a-ghorbani requested a review from jhen0409 February 15, 2026 16:51
@a-ghorbani
Copy link
Collaborator Author

We had breaking changes again in llama.cpp, added Q4_1 and Q4_K OpenCL kernels plus a new simd-gemm.h header., so we had to manually fix it. @jhen0409 this is ready for review. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants