Skip to content

Much faster prompt processing for I-quants (ARM_NEON)#550

Merged
ikawrakow merged 5 commits intomainfrom
ik/gemm_neon_iquants
Jun 23, 2025
Merged

Much faster prompt processing for I-quants (ARM_NEON)#550
ikawrakow merged 5 commits intomainfrom
ik/gemm_neon_iquants

Commits

Commits on Jun 23, 2025

  • iq2_xxs

    author
    Iwan Kawrakow
    committed
    edb5f9c

  • iq2_xs

    author
    Iwan Kawrakow
    committed
    8b33186

  • iq2_s

    author
    Iwan Kawrakow
    committed
    c52f589

  • iq3_xxs

    author
    Iwan Kawrakow
    committed
    2696567

  • iq3_s

    author
    Iwan Kawrakow
    committed
    548a5f3