Skip to content

Commit 5ad117d

Browse files
committed
vulkan: fix shmem overrun in mmq id shader
1 parent 16724b5 commit 5ad117d

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

ggml/src/ggml-vulkan/vulkan-shaders/mul_mmq.comp

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -83,8 +83,12 @@ layout (constant_id = 10) const uint WARP = 32;
8383
#include "mul_mmq_shmem_types.glsl"
8484

8585
#ifndef BK_STEP
86+
#ifdef MUL_MAT_ID
87+
#define BK_STEP 1
88+
#else
8689
#define BK_STEP 4
8790
#endif
91+
#endif
8892

8993
// Shared memory cache
9094
shared block_a_cache buf_a[BM * BK_STEP];

0 commit comments

Comments
 (0)