Static quant fallback improvements#4

Merged

nicoboss merged 1 commit intomradermacherfrom

static-quant-fallback-improvements

Jun 7, 2025

Commits on Jun 7, 2025

Statically quant tensors where the imatrix size differs and fix "Missing importance matrix for tensor XXX in a very low-bit quantization" by instead using the nearest static quant with better quali…
nicoboss
committed