Skip to content

Commit f5b8443

Browse files
authored
[Fix] remove internvl template in LEGO (#1264)
* [Fix] remove internvl template in LEGO * lint: format code
1 parent c22df66 commit f5b8443

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

vlmeval/vlm/internvl/internvl_chat.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -238,6 +238,9 @@ def use_custom_prompt(self, dataset):
238238
if listinstr(['MMDU', 'MME-RealWorld', 'MME-RealWorld-CN', 'WeMath_COT', 'MMAlignBench'], dataset):
239239
# For Multi-Turn we don't have custom prompt
240240
return False
241+
if DATASET_TYPE(dataset) == 'MCQ':
242+
if dataset is not None and 'LEGO' in dataset:
243+
return False
241244
if DATASET_MODALITY(dataset) == 'VIDEO':
242245
# For Video benchmarks we don't have custom prompt at here
243246
return False

0 commit comments

Comments
 (0)