Skip to content

Conversation

ggerganov
Copy link
Member

  • Dynamically scale number of simdgroups based on ne00
  • Generalize MV kernel for small ne00

@github-actions github-actions bot added ggml changes relating to the ggml tensor library for machine learning Apple Metal https://en.wikipedia.org/wiki/Metal_(API) labels Sep 29, 2025
@ggerganov ggerganov merged commit 35fb824 into master Sep 30, 2025
1 check passed
@ggerganov ggerganov deleted the gg/metal-mul-mv-opt-3 branch September 30, 2025 08:03
yael-works pushed a commit to yael-works/llama.cpp that referenced this pull request Oct 15, 2025
* metal : dynamic simdgroups for MV kernels

* cont : minor
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Apple Metal https://en.wikipedia.org/wiki/Metal_(API) ggml changes relating to the ggml tensor library for machine learning

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant