Much faster prompt processing for k-quants (ARM_NEON)#552

Merged

ikawrakow merged 12 commits intomainfrom

ik/gemm_neon_kquants

Jun 24, 2025

Commits on Jun 23, 2025

iq2_xxs
Iwan Kawrakow
committed
iq2_xs
Iwan Kawrakow
committed
iq2_s
Iwan Kawrakow
committed
iq3_xxs
Iwan Kawrakow
committed
iq3_s
Iwan Kawrakow
committed
q2_k
Iwan Kawrakow
committed
q3_K
Iwan Kawrakow
committed

Commits on Jun 24, 2025

q6_k
Iwan Kawrakow
committed
q4_k
Iwan Kawrakow
committed
q5_k
Iwan Kawrakow
committed
iq4_xs
Iwan Kawrakow
committed
Merge remote-tracking branch 'origin/main' into ik/gemm_neon_kquants
Iwan Kawrakow
committed