Is AVX2 a hard requirement on x64?

[SmallAndSoft]

I am getting compilation errors on the older CPU with just AVX even if I want to offload everything to CUDA GPU.

[ikawrakow]

Yes, AVX2 or better is a hard requirement on x86_64. I think llama.cpp is a better option for older hardware.

[SmallAndSoft]

Thank you for reply. Yes, I just wanted to try your advanced quants on GPU. It is sad that AVX2 is required even if CPU will be doing next to nothing.