Skip to content

Commit 2659303

Browse files
authored
fix kto (#2478)
1 parent 5521907 commit 2659303

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

swift/trainers/rlhf_trainer/kto_trainer.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -37,7 +37,7 @@ def _add_kl_dataset(dataset: LLMDataset, total_batch_size: int, seed: Optional[i
3737
'labels': data['labels'],
3838
'KL_input_ids': kl_input_ids,
3939
'KL_labels': kl_labels,
40-
'label': kl_data['label']
40+
'label': data['label']
4141
})
4242
raw_dataset[i:i + total_batch_size] = new_dataset_group
4343
i += total_batch_size

0 commit comments

Comments
 (0)