Skip to content

Commit 14ac9ff

Browse files
use default cpu quantizer
1 parent e1b1564 commit 14ac9ff

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

examples/models/llama/source_transformation/quantize.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -82,7 +82,6 @@ def quantize( # noqa C901
8282

8383
with torch.no_grad():
8484
model = UIntxWeightOnlyLinearQuantizer(
85-
device="mps",
8685
precision=torch.float32,
8786
groupsize=group_size,
8887
bitwidth=bitwidth

0 commit comments

Comments
 (0)