Skip to content

Commit eb7c61c

Browse files
authored
[Tests] Fix oneshot + finetune test by passing splits to oneshot (#1316)
## Purpose ## * Fix test which was failing because the calibration split was not explicitly passed to the oneshot call. While normally this would not be a problem, as `make_dataset_splits` will auto-infer which split is the calibration split, the `make_dataset_splits` function does its inference using the split name `train`, whereas ultrachat uses the spilt name `train_sft`. ## Changes ## * Pass `splits` argument to oneshot and train calls. This also reduces the runtime of the test significantly. --------- Signed-off-by: Kyle Sayers <[email protected]>
1 parent ca5988a commit eb7c61c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/llmcompressor/transformers/finetune/test_oneshot_and_finetune.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -25,6 +25,7 @@ def _test_oneshot_and_finetune(self):
2525

2626
oneshot_args = dict(
2727
dataset=self.dataset,
28+
splits=splits,
2829
output_dir=self.output,
2930
recipe=self.recipe,
3031
num_calibration_samples=64,
@@ -36,7 +37,6 @@ def _test_oneshot_and_finetune(self):
3637

3738
train_args = dict(
3839
num_train_epochs=self.num_train_epochs,
39-
splits=splits,
4040
precision="bfloat16",
4141
bf16=True,
4242
)

0 commit comments

Comments
 (0)