Skip to content

Commit e919e89

Browse files
ikawrakowIwan Kawrakow
andauthored
Fix more Q8_0 repacking mess on AVX2 (#719)
Co-authored-by: Iwan Kawrakow <[email protected]>
1 parent 9351cc3 commit e919e89

File tree

1 file changed

+2
-4
lines changed

1 file changed

+2
-4
lines changed

ggml/src/iqk/iqk_mul_mat.cpp

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -502,10 +502,8 @@ extern "C" IQK_API bool iqk_mul_mat(long Nx, long Ny, long ne00,
502502
MulMat mm;
503503

504504
auto etypeA = ggml_type(typeA);
505-
if (auto dequant_type = MulMat::is_dequant_better(etypeA, Ny); dequant_type != etypeA) {
506-
if (!MulMat::prepare(dequant_type, typeB, ne00, mm, Ny)) {
507-
return false;
508-
}
505+
if (auto dequant_type = MulMat::is_dequant_better(etypeA, Ny);
506+
dequant_type != etypeA && MulMat::prepare(dequant_type, typeB, ne00, mm, Ny)) {
509507

510508
constexpr int k_x_step = 32;
511509

0 commit comments

Comments
 (0)