Skip to content

Commit 964f811

Browse files
Update ggml/src/ggml-cpu/ggml-cpu-quants.c
change to use K_SCALE_SIZE Co-authored-by: Georgi Gerganov <[email protected]>
1 parent 5f98b7c commit 964f811

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

ggml/src/ggml-cpu/ggml-cpu-quants.c

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5582,7 +5582,7 @@ void ggml_vec_dot_q4_K_q8_K(int n, float * restrict s, size_t bs, const void * r
55825582

55835583
const int16x8_t q8sums = vpaddq_s16(vld1q_s16(y[i].bsums), vld1q_s16(y[i].bsums + 8));
55845584

5585-
memcpy(utmp, x[i].scales, 12);
5585+
memcpy(utmp, x[i].scales, K_SCALE_SIZE);
55865586

55875587
uint32x2_t mins8 = { 0 };
55885588
mins8 = vset_lane_u32(utmp[1] & kmask1, mins8, 0);

0 commit comments

Comments
 (0)