Skip to content

Commit 26e36cd

Browse files
fix: MTEB-NL switches to v2 datasets with new prompts (#3555)
MTEB-NL swithes to v2 datasets with new prompts
1 parent 64459d1 commit 26e36cd

File tree

1 file changed

+5
-5
lines changed

1 file changed

+5
-5
lines changed

mteb/benchmarks/benchmarks/benchmarks.py

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1647,7 +1647,7 @@
16471647
exclusive_language_filter=True,
16481648
tasks=[
16491649
# Classification
1650-
"DutchBookReviewSentimentClassification",
1650+
"DutchBookReviewSentimentClassification.v2",
16511651
"MassiveIntentClassification",
16521652
"MassiveScenarioClassification",
16531653
"SIB200Classification",
@@ -1678,10 +1678,10 @@
16781678
# # Reranking
16791679
"WikipediaRerankingMultilingual",
16801680
# # Retrieval
1681-
"ArguAna-NL",
1682-
"SCIDOCS-NL",
1683-
"SciFact-NL",
1684-
"NFCorpus-NL",
1681+
"ArguAna-NL.v2",
1682+
"SCIDOCS-NL.v2",
1683+
"SciFact-NL.v2",
1684+
"NFCorpus-NL.v2",
16851685
"BelebeleRetrieval",
16861686
"WebFAQRetrieval",
16871687
"DutchNewsArticlesRetrieval",

0 commit comments

Comments
 (0)