Skip to content

Commit 304f7b9

Browse files
HDCharlesdsikka
andauthored
correct model save name in example fp8 dynamic (#2475)
SUMMARY: this was misleading as in #2330 Signed-off-by: HDCharles <39544797+HDCharles@users.noreply.github.com> Co-authored-by: Dipika Sikka <dipikasikka1@gmail.com>
1 parent 2603fc1 commit 304f7b9

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/awq/fp8_dynamic_llama_example.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -76,6 +76,6 @@ def tokenize(sample):
7676
print("==========================================\n\n")
7777

7878
# Save to disk compressed.
79-
SAVE_DIR = MODEL_ID.rstrip("/").split("/")[-1] + "-awq-asym"
79+
SAVE_DIR = MODEL_ID.rstrip("/").split("/")[-1] + "-awq-fp8-dynamic"
8080
model.save_pretrained(SAVE_DIR, save_compressed=True)
8181
tokenizer.save_pretrained(SAVE_DIR)

0 commit comments

Comments
 (0)