Skip to content

Commit 0ead029

Browse files
authored
Almost final descriptive stats (#3463)
* fix tasks * final statistics * remove persiantexttone, was renamed to SynPerTextToneClassification * remove duplicated tasks statistics * fix category * run test on all tasks * remove `image/text: None` * try to fix none in batch * add vdr statistics
1 parent b649e6f commit 0ead029

33 files changed

+1473
-1766
lines changed

mteb/_create_dataloaders.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -277,6 +277,8 @@ def _custom_collate_fn(batch: list[dict[str, Any]]) -> dict[str, Any]:
277277
# Leave the images as a list to avoid stacking errors.
278278
collated[key] = [item[key] for item in batch]
279279
else:
280+
if any(item[key] is None for item in batch):
281+
raise ValueError(f"Found None in batch for key '{key}'")
280282
collated[key] = default_collate([item[key] for item in batch])
281283
return collated
282284

mteb/descriptive_stats/Classification/PersianTextTone.json

Lines changed: 0 additions & 56 deletions
This file was deleted.

0 commit comments

Comments
 (0)