Skip to content

Commit f44d4a2

Browse files
committed
fix matmul8bit fp
Signed-off-by: jiqing-feng <[email protected]>
1 parent 959a0d4 commit f44d4a2

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

bitsandbytes/autograd/_functions.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -425,7 +425,7 @@ def matmul(
425425
if threshold > 0.0:
426426
state.threshold = threshold
427427
# MatMul8bitLt is slower because no fast kernel for quant/dequant 8bit in CPU/XPU
428-
if A.device.type in ("cpu", "xpu") and state.is_training and getattr(state, "ipex", False):
428+
if A.device.type in ("cpu", "xpu") and state.is_training:
429429
return MatMul8bitFp.apply(A, B, out, bias, state)
430430
return MatMul8bitLt.apply(A, B, out, bias, state)
431431

0 commit comments

Comments
 (0)