Skip to content

Much faster prompt processing for IQK quants (ARM_NEON)#549

Merged
ikawrakow merged 7 commits intomainfrom
ik/gemm_neon_iqk
Jun 23, 2025
Merged

Much faster prompt processing for IQK quants (ARM_NEON)#549
ikawrakow merged 7 commits intomainfrom
ik/gemm_neon_iqk

Commits

Commits on Jun 22, 2025

Commits on Jun 23, 2025

  • iq5_k

    author
    Iwan Kawrakow
    committed
    54dfc40

  • iq4_k

    author
    Iwan Kawrakow
    committed
    a15cfa0

  • iq3_k

    author
    Iwan Kawrakow
    committed
    c15688c

  • iq2_k

    author
    Iwan Kawrakow
    committed
    ec4b453