Skip to content

Commit 34b8f02

Browse files
committed
Increase block size for q kernel to 256
ggml-ci
1 parent d1e09ef commit 34b8f02

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

ggml/src/ggml-sycl/set_rows.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -48,7 +48,7 @@ static void set_rows_sycl_q(const char * __restrict__ src0_d,
4848
const size_t nb3,
4949
queue_ptr stream) {
5050
const int64_t total_blocks = (ne00 * ne01 * ne02 * ne03) / qk;
51-
constexpr int block_size = 64;
51+
constexpr int block_size = 256;
5252
const int64_t grid_size = ceil_div(total_blocks, block_size);
5353

5454
sycl_parallel_for(stream, sycl::nd_range<1>(grid_size * block_size, block_size), [=](sycl::nd_item<1> item_ct1) {

0 commit comments

Comments
 (0)