Skip to content

Commit 1b3f4a9

Browse files
committed
Renamed the guess surah JSONL files to match the YAML
1 parent b5cede0 commit 1b3f4a9

File tree

3 files changed

+2
-2
lines changed

3 files changed

+2
-2
lines changed

evals/registry/evals/quran_eval.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
guess_quran_surah_name:
22
id: guess_quran_surah_name.dev.v0
3-
description: Tests the model's ability to guess the name of a Quranic verse.
3+
description: Tests the model's ability to guess the name of a Quranic surah (chapter).
44
metrics: [accuracy]
55
guess_quran_surah_name.dev.v0:
66
class: evals.elsuite.modelgraded.classify:ModelBasedClassify
@@ -11,7 +11,7 @@ guess_quran_surah_name.dev.v0:
1111

1212
guess_quran_surah_type:
1313
id: guess_quran_surah_type.dev.v0
14-
description: Tests the model's ability to guess the type of a Quranic verse (e.g. Meccan or Medinan)
14+
description: Tests the model's ability to guess the type of a Quranic Surah (chapter) for a given verse (Aya) (e.g. Meccan or Medinan)
1515
metrics: [accuracy]
1616
guess_quran_surah_type.dev.v0:
1717
class: evals.elsuite.modelgraded.classify:ModelBasedClassify

0 commit comments

Comments
 (0)