Skip to content

Commit 2b146f0

Browse files
tastelikefeettastelikefeet
andauthored
Fix embedding padding_free (#6100)
Co-authored-by: tastelikefeet <[email protected]>
1 parent a3e5bc1 commit 2b146f0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

swift/llm/template/base.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -553,7 +553,7 @@ def packing_row(self, row: List[Dict[str, Any]]) -> Dict[str, Any]:
553553
length.append(r['length'])
554554
for key in keys:
555555
if key in {'input_ids', 'labels', 'loss_scale'}:
556-
packed[key] = sum((x[key] for x in row), start=[])
556+
packed[key] = sum((x.get(key) or [] for x in row), start=[])
557557
elif key == 'length':
558558
packed[key] = sum((x[key] for x in row))
559559
elif key == 'channel':

0 commit comments

Comments
 (0)