Various#181

Merged

ikawrakow merged 7 commits intomainfrom

Jan 29, 2025

Commits on Jan 28, 2025

Adding gp option to llama-bench
Iwan Kawrakow
committed
Make q8_0_r4 work with tensor row sizes that are not a multiple of 128
Iwan Kawrakow
committed
Make q8_0_r4 work with tensor row sizes that are not a multiple of 128
Iwan Kawrakow
committed
Make q8_0_r4 work with tensor row sizes that are not a multiple of 128
Iwan Kawrakow
committed

Commits on Jan 29, 2025

Make q4_0_r4 work with tensor row sizes that are not a multiple of 128
Iwan Kawrakow
committed
Make q4_0_r4 work with tensor row sizes that are not a multiple of 128
Iwan Kawrakow
committed
Make q4_0_r4 work with tensor row sizes that are not a multiple of 128
Iwan Kawrakow
committed