Much faster CPU prompt processing (part 2)#533

Merged

ikawrakow merged 9 commits intomainfrom

Jun 18, 2025

Commits on Jun 17, 2025

iq4_ks
Iwan Kawrakow
committed
iq4_k
Iwan Kawrakow
committed
iq5_ks
Iwan Kawrakow
committed
iq5_k - accuracy loss is too big
Iwan Kawrakow
committed
iq5_k - there was a bug with the shifts
Iwan Kawrakow
committed
iq6_k
Iwan Kawrakow
committed
iq3_k
Iwan Kawrakow
committed
iq2_k
Iwan Kawrakow
committed
iq2_ks
Iwan Kawrakow
committed