You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: _editions/2026.md
+10-11Lines changed: 10 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,13 +5,12 @@ year: 2026
5
5
permalink: /editions/2026/
6
6
---
7
7
8
-
The MediaEval Multimedia Evaluation benchmark offers challenges in artificial intelligence for multimedia data.
9
-
Participants address these challenges by creating algorithms for analyzing, exploring and accessing information in the data. Solutions are systematically compared using a common evaluation procedure,
10
-
making it possible to establish the state of the art and track progress. Our larger aim is to promote reproducible research that makes multimedia a positive force for society.
8
+
The MediaEval Multimedia Evaluation benchmark offers challenges in artificial intelligence for multimedia data, with a focus on analysis, exploration, and information access and retrieval. Signup is open to anyone who wishes to participate. There are two types of participation: “standard” participation requires creating an algorithm for addressing the challenge and “insight” participation requires gaining new insight, e.g., into the data, the evaluation procedure, or the implications of the task. Participating teams submit their algorithms (for the “standard” participation) and write up papers for the working notes proceedings (both “standard” and “insight” participation). The larger aim of MediaEval is to promote reproducible research that makes multimedia a positive force for society.
9
+
10
+
In the 2026 edition, we will offer the same slate of tasks as in the 2025 edition in order to provide opportunities for teams who were not able to participate in 2025. Also, we will put special emphasis on “insight” participation. Specifically, we welcome “Quest for Insight” papers that examine characteristics of the data and the task definitions, the strengths and weaknesses of particular types of approaches, observations about the evaluation procedure, and implications of the task.
11
+
12
+
Participating teams present their work at the annual MediaEval workshop. The workshop will take place in Amsterdam, Netherlands, and also offer the possibility of online participation. If you are an early career researcher and funding restrictions are preventing your participation, please inquire about possible travel support. This edition will be co-located with ACM International Conference on Multimedia Retrieval - [ICMR2026](https://icmr2026.org/).
11
13
12
-
MediaEval goes beyond other benchmarks and data science challenges in that it also pursues a “Quest for Insight” (Q4I). With Q4I we push beyond only striving to improve evaluation
13
-
scores to also working to achieve deeper understanding about the challenges. For example, characteristics of the data, strengths and weaknesses of particular types of approaches, and observations
14
-
about the evaluation procedure.
15
14
16
15
##### Registration:
17
16
Signup for MediaEval 2026 opens in January.
@@ -21,7 +20,7 @@ Signup for MediaEval 2026 opens in January.
21
20
* Test data release: 1 March 2026
22
21
* Runs due: 1 May 2026
23
22
* Working notes papers due: 31 May 2026
24
-
* MediaEval 2026 Workshop, Sat.-Sun. 15-16 June 2026, Amsterdam, Netherlands and Online.
23
+
* MediaEval 2026 Workshop, Sat.-Sun. 15-16 June 2026, Amsterdam, Netherlands and Online, co-located with ACM ICMR 2026
25
24
26
25
##### The MediaEval Coordination Committee (2026):
27
26
* Mihai Gabriel Constantin, National University of Science and Technology Politehnica Bucharest, Romania
@@ -30,19 +29,19 @@ Signup for MediaEval 2026 opens in January.
30
29
31
30
### Task List
32
31
33
-
**Medico 2026: Visual Question Answering (VQA) for Gastrointestinal Imaging**
32
+
##### Medico 2026: Visual Question Answering (VQA) for Gastrointestinal Imaging
34
33
35
34
Medico 2026 focuses on Visual Question Answering (VQA) for gastrointestinal (GI) imaging, with an emphasis on explainability, clinical safety, and multimodal reasoning. The task leverages the expanded Kvasir-VQA-x1 dataset, containing more than 150,000 clinically relevant question–answer pairs, to support the development of AI models that can accurately answer questions based on GI endoscopy images while providing coherent and clinically grounded explanations. The goal is to advance trustworthy and interpretable AI decision support for GI diagnostics.
36
35
37
-
**Memorability: Predicting movie and commercial memorability task**
36
+
##### Memorability: Predicting movie and commercial memorability task
38
37
39
38
The goal of this task is to study the long-term memory performance when recognising small movie excerpts or commercial videos. We provide the videos, precomputed features or EEG features for the challenges proposed in the task such as how memorable a video, if a person is familiar with a video or if you can predict the brand memorability?
40
39
41
-
**NewsImages at MediaEval 2026 Retrieval and Generative AI for News Thumbnails**
40
+
##### NewsImages at MediaEval 2026 Retrieval and Generative AI for News Thumbnails
42
41
43
42
Participants receive a large set of articles (including the headline and article lead) in the English-language from international publishers. We offer two subtasks: retrieving an image for each article from a collection of images that can serve as a thumbnail, or generating an article thumbnail.
44
43
45
-
**Synthetic Images: Advancing detection and localization of generative AI used in real-world online images**
44
+
##### Synthetic Images: Advancing detection and localization of generative AI used in real-world online images
46
45
47
46
The goal of this challenge is to develop AI models capable of detecting synthetic images and identifying the specific regions in the images that have been manipulated or synthesized. Approaches will be tested on images synthesized with state-of-the-art approaches and collected from real-world settings online.
0 commit comments