Skip to content

Commit d3e14ef

Browse files
committed
Hotfix for fallback
#369
1 parent 6aa9866 commit d3e14ef

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

dequant.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ def dequantize_tensor(tensor, dtype=None, dequant_dtype=None):
2323
return dequantize(tensor.data, qtype, oshape, dtype=dequant_dtype).to(dtype)
2424
else:
2525
# this is incredibly slow
26-
tqdm.write(f"Falling back to numpy dequant for qtype: {getattr(qtype, "name", repr(qtype))}")
26+
tqdm.write(f"Falling back to numpy dequant for qtype: {getattr(qtype, 'name', repr(qtype))}")
2727
new = gguf.quants.dequantize(tensor.cpu().numpy(), qtype)
2828
return torch.from_numpy(new).to(tensor.device, dtype=dtype)
2929

0 commit comments

Comments
 (0)