Who can help?When I was training with DPOTrainer.train(), the following error occurred

[mmmaxyoung]

Traceback (most recent call last):
File "/090008/DPO-ST/dpo.py", line 72, in main
dpo_trainer.train()
File "/root/anaconda3/envs/dpo/lib/python3.10/site-packages/transformers/trainer.py", line 1859, in train
return inner_training_loop(
File "/root/anaconda3/envs/dpo/lib/python3.10/site-packages/transformers/trainer.py", line 2165, in _inner_training_loop
for step, inputs in enumerate(epoch_iterator):
File "/root/anaconda3/envs/dpo/lib/python3.10/site-packages/accelerate/data_loader.py", line 564, in iter
current_batch = next(dataloader_iter)
File "/root/anaconda3/envs/dpo/lib/python3.10/site-packages/torch/utils/data/dataloader.py", line 708, in next
data = self._next_data()
File "/root/anaconda3/envs/dpo/lib/python3.10/site-packages/torch/utils/data/dataloader.py", line 1480, in _next_data
return self._process_data(data)
File "/root/anaconda3/envs/dpo/lib/python3.10/site-packages/torch/utils/data/dataloader.py", line 1505, in _process_data
data.reraise()
File "/root/anaconda3/envs/dpo/lib/python3.10/site-packages/torch/_utils.py", line 733, in reraise
raise exception
TypeError: Caught TypeError in DataLoader worker process 0.
Original Traceback (most recent call last):
File "/root/anaconda3/envs/dpo/lib/python3.10/site-packages/torch/utils/data/_utils/worker.py", line 349, in _worker_loop
data = fetcher.fetch(index) # type: ignore[possibly-undefined]
File "/root/anaconda3/envs/dpo/lib/python3.10/site-packages/torch/utils/data/_utils/fetch.py", line 55, in fetch
return self.collate_fn(data)
File "/root/anaconda3/envs/dpo/lib/python3.10/site-packages/trl/trainer/utils.py", line 384, in call
to_pad = [torch.LongTensor(ex[k]) for ex in features]
File "/root/anaconda3/envs/dpo/lib/python3.10/site-packages/trl/trainer/utils.py", line 384, in
to_pad = [torch.LongTensor(ex[k]) for ex in features]
TypeError: 'NoneType' object cannot be interpreted as an integer