Skip to content

Commit 6651f60

Browse files
committed
Use the vector/matrix shader for larger matrix/vector computations.
Signed-off-by: Marcus Edel <[email protected]>
1 parent 5f19b2a commit 6651f60

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

ggml/src/ggml-vulkan/ggml-vulkan.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -216,7 +216,7 @@ class vk_memory_logger;
216216
class vk_perf_logger;
217217
static void ggml_vk_destroy_buffer(vk_buffer& buf);
218218

219-
static constexpr uint32_t mul_mat_vec_max_cols = 8;
219+
static constexpr uint32_t mul_mat_vec_max_cols = 16;
220220
static constexpr uint32_t p021_max_gqa_ratio = 8;
221221

222222
enum vk_device_architecture {

0 commit comments

Comments
 (0)