Skip to content

Commit 2fe0027

Browse files
authored
Fix Sparse2of4 Example (#1182)
Summary - Should be saving compressed for all cases
1 parent f326cd4 commit 2fe0027

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/sparse_2of4_quantization_fp8/llama3_8b_2of4.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -116,5 +116,5 @@ def get_recipe(fp8_enabled):
116116
print("==========================================\n")
117117

118118
# Save compressed model and tokenizer
119-
model.save_pretrained(save_dir, save_compressed=args.fp8)
119+
model.save_pretrained(save_dir)
120120
tokenizer.save_pretrained(save_dir)

0 commit comments

Comments
 (0)