Skip to content

Commit 933414c

Browse files
authored
vulkan: add more num_blocks instantiations in rms_norm (ggml-org#17701)
1 parent a0f3897 commit 933414c

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

ggml/src/ggml-vulkan/vulkan-shaders/rms_norm.comp

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -131,8 +131,12 @@ void main() {
131131
rms_norm(num_blocks);
132132
} else if (num_blocks > 16) {
133133
rms_norm(32);
134-
} else if (num_blocks > 8) {
134+
} else if (num_blocks > 12) {
135135
rms_norm(16);
136+
} else if (num_blocks > 10) {
137+
rms_norm(12);
138+
} else if (num_blocks > 8) {
139+
rms_norm(10);
136140
} else if (num_blocks > 4) {
137141
rms_norm(8);
138142
} else if (num_blocks == 4) {

0 commit comments

Comments
 (0)