Skip to content

Commit 97d5bd1

Browse files
committed
fix dequantize nf4 xpu
Signed-off-by: jiqing-feng <[email protected]>
1 parent 7f2d8a8 commit 97d5bd1

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

bitsandbytes/functional.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1124,7 +1124,7 @@ def dequantize_4bit(
11241124
absmax = absmax.float()
11251125

11261126
# IPEX format is different, we need extra process.
1127-
if getattr(quant_state, "ipex", False) and quant_type == "nf4":
1127+
if getattr(quant_state, "ipex", False) and quant_state.quant_type == "nf4":
11281128
if A.device.type == "xpu":
11291129
out = torch.ops.torch_ipex.dequantize_4bit(A, "nf4", quant_state.shape, absmax, None, blocksize).t()
11301130
return out

0 commit comments

Comments
 (0)