Skip to content

Commit 94a3e53

Browse files
authored
[Examples] Fix qwen vision examples (#1481)
## Purpose ## * Fix qwen vision examples ## Background ## * After #1118 merged, some examples no longer produce explicit "calibration" splits ## Changes ## * Do not explicitly get "calibration" split for qwen examples --------- Signed-off-by: Kyle Sayers <[email protected]>
1 parent 10fd4e9 commit 94a3e53

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

examples/multimodal_vision/qwen2_vl_example.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@ def preprocess_and_tokenize(example):
6969
)
7070

7171

72-
ds = ds.map(preprocess_and_tokenize, remove_columns=ds["calibration"].column_names)
72+
ds = ds.map(preprocess_and_tokenize, remove_columns=ds.column_names)
7373

7474

7575
# Define a oneshot data collator for multimodal inputs.

examples/multimodal_vision/qwen_2_5_vl_example.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -65,7 +65,7 @@ def preprocess_and_tokenize(example):
6565
)
6666

6767

68-
ds = ds.map(preprocess_and_tokenize, remove_columns=ds["calibration"].column_names)
68+
ds = ds.map(preprocess_and_tokenize, remove_columns=ds.column_names)
6969

7070

7171
# Define a oneshot data collator for multimodal inputs.

0 commit comments

Comments
 (0)