Skip to content

Commit c9a24fb

Browse files
authored
vulkan: Support FA with any multiple of 8 head sizes (ggml-org#15537)
The scalar FA shader already handled multiples of 8. The coopmat1 FA shader assumed 16x16x16 and the shared memory allocations need the HSK dimensions padded to a multiple of 16. NVIDIA's coopmat2 implementation requires multiples of 16 for N and K, and needs the matrix dimensions padded and loads clamped. Store the FA pipelines in a map, indexed by the pipeline state.
1 parent a9c6ffc commit c9a24fb

File tree

5 files changed

+143
-137
lines changed

5 files changed

+143
-137
lines changed

0 commit comments

Comments
 (0)