Skip to content

Commit 8edae24

Browse files
authored
Update llama3.3_70b.py (#1739)
Summary - Reduce number of samples as fairly hefty example
1 parent c537ea3 commit 8edae24

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

examples/big_models_with_sequential_onloading/llama3.3_70b.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -19,9 +19,9 @@
1919
DATASET_ID = "HuggingFaceH4/ultrachat_200k"
2020
DATASET_SPLIT = "train_sft"
2121

22-
# Select number of samples. 512 samples is a good place to start.
22+
# Select number of samples.
2323
# Increasing the number of samples can improve accuracy.
24-
NUM_CALIBRATION_SAMPLES = 512
24+
NUM_CALIBRATION_SAMPLES = 256
2525
MAX_SEQUENCE_LENGTH = 2048
2626

2727
# Load dataset and preprocess.

0 commit comments

Comments
 (0)