Skip to content

Commit 8f71004

Browse files
committed
fix example
Signed-off-by: Kyle Sayers <[email protected]>
1 parent a64a777 commit 8f71004

File tree

1 file changed

+1
-3
lines changed
  • examples/quantization_2of4_sparse_w4a16

1 file changed

+1
-3
lines changed

examples/quantization_2of4_sparse_w4a16/README.md

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -49,9 +49,7 @@ import torch
4949
from transformers import AutoModelForCausalLM
5050

5151
model_stub = "neuralmagic/Llama-2-7b-ultrachat200k"
52-
model = AutoModelForCausalLM.from_pretrained(
53-
model_stub, torch_dtype=torch.bfloat16, device_map="auto"
54-
)
52+
model = AutoModelForCausalLM.from_pretrained(model_stub, torch_dtype=torch.bfloat16)
5553

5654
dataset = "ultrachat-200k"
5755
splits = {"calibration": "train_gen[:5%]", "train": "train_gen"}

0 commit comments

Comments
 (0)