BF16 Trellis implementation#484

Closed

ikawrakow wants to merge 4 commits intomainfrom

ik/trellis_bf16

Commits on Jun 1, 2025

If available, use bf16 for iq2_kt gemm/gemv
Iwan Kawrakow
committed

Commits on Jun 2, 2025

If available, use bf16 for iq3_kt gemm/gemv
Iwan Kawrakow
committed
BF16 for iq4_kt
Iwan Kawrakow
committed
If available, use bf16 for iq4_kt gemm/gemv
Iwan Kawrakow
committed