Skip to content

Commit bf7dec6

Browse files
0cc4mwalidbr
authored andcommitted
vulkan: disable large mmv subgroups on older Nvidia GPUs (ggml-org#15717)
1 parent a7c1974 commit bf7dec6

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

ggml/src/ggml-vulkan/ggml-vulkan.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4765,7 +4765,7 @@ static vk_pipeline ggml_vk_get_dequantize_mul_mat_vec(ggml_backend_vk_context *
47654765

47664766
// heuristic to choose workgroup size
47674767
uint32_t dmmv_wg = DMMV_WG_SIZE_SUBGROUP;
4768-
if (ctx->device->vendor_id == VK_VENDOR_ID_NVIDIA || ctx->device->vendor_id == VK_VENDOR_ID_INTEL) {
4768+
if ((ctx->device->vendor_id == VK_VENDOR_ID_NVIDIA && ctx->device->architecture != vk_device_architecture::NVIDIA_PRE_TURING) || ctx->device->vendor_id == VK_VENDOR_ID_INTEL) {
47694769
// Prefer larger workgroups when M is small, to spread the work out more
47704770
// and keep more SMs busy.
47714771
// q6_k seems to prefer small workgroup size even for "medium" values of M.

0 commit comments

Comments
 (0)