Skip to content

Commit e52a0f2

Browse files
committed
vulkan: increase small tile size for NV_coopmat2
1 parent 2625283 commit e52a0f2

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

ggml/src/ggml-vulkan/ggml-vulkan.cpp

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1404,10 +1404,10 @@ static void ggml_vk_load_shaders(vk_device& device) {
14041404
// spec constants and tile sizes for non-quant matmul/matmul_id
14051405
l_warptile = { 256, 128, 256, 64 };
14061406
m_warptile = { 256, 128, 128, 64 };
1407-
s_warptile = { 128, 32, 16, 64 };
1407+
s_warptile = { 128, 64, 64, 64 };
14081408
l_wg_denoms = {128, 256, 1 };
14091409
m_wg_denoms = {128, 128, 1 };
1410-
s_wg_denoms = { 32, 16, 1 };
1410+
s_wg_denoms = { 64, 64, 1 };
14111411

14121412
// spec constants and tile sizes for quant matmul (non-Qi_K)
14131413
l_warptile_mmq = { 256, 128, 256, 64 };

0 commit comments

Comments
 (0)