Skip to content

CUDA: skip fully masked-out KV in FA vec kernel#13584

Merged
JohannesGaessler merged 2 commits intoggml-org:masterfrom
JohannesGaessler:cuda-fa-opt-8
May 20, 2025
Merged

CUDA: skip fully masked-out KV in FA vec kernel#13584
JohannesGaessler merged 2 commits intoggml-org:masterfrom
JohannesGaessler:cuda-fa-opt-8

Commits

Commits on May 15, 2025

Commits on May 16, 2025