Skip to content

Commit 4be1afc

Browse files
committed
Added leaderboard for shared task
1 parent 0d22cdd commit 4be1afc

File tree

1 file changed

+76
-1
lines changed

1 file changed

+76
-1
lines changed

_pages/mm-argfallacy2025.md

Lines changed: 76 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -248,7 +248,7 @@ All evaluated submissions are required to commit to submitting a system descript
248248

249249
All papers must use the official [ACL style templates](https://github.com/acl-org/acl-style-files), available in both LaTeX and Word. We strongly recommend using the official [Overleaf template](https://www.overleaf.com/project/5f64f1fb97c4c50001b60549) for convenience.
250250

251-
Submissions will be made via a dedicated submission website, which will be published soon.
251+
We have sent an email to each team with all the details regarding the system description paper submission for MM-ArgFallacy2025. Please check your inbox (and spam folder just in case).
252252

253253
- 🗓️ **Submissions open**: May 1st, 2025 (the day after the end of the evaluation period)
254254
- 🗓️ **Submissions close**: May 15th, 2025
@@ -261,6 +261,81 @@ Submissions will be made via a dedicated submission website, which will be publi
261261

262262
We look forward to receiving your submissions!
263263

264+
## 🏆 Leaderboard – Shared Task Results
265+
266+
### `AFC Task – Argumentative Fallacy Classification`
267+
268+
#### 📝 Text-only
269+
270+
271+
| Rank | Team | F1-Macro |
272+
|------|------------------------|----------|
273+
| 1 | Team NUST | 0.4856 |
274+
| 2 | Baseline BiLSTM | 0.4721 |
275+
| 3 | alessiopittiglio | 0.4444 |
276+
| 4 | Baseline RoBERTa | 0.3925 |
277+
| 5 | Team EvaAdriana | 0.3746 |
278+
| 6 | Team CASS | 0.1432 |
279+
280+
#### 🔊 Audio-only
281+
282+
283+
| Rank | Team | F1-Macro |
284+
|------|---------------------------|----------|
285+
| 1 | alessiopittiglio | 0.3559 |
286+
| 2 | Team EvaAdriana | 0.1858 |
287+
| 3 | Team NUST | 0.1588 |
288+
| 4 | Baseline BiLSTM + MFCCs | 0.1582 |
289+
| 5 | Team CASS | 0.0864 |
290+
| 6 | Baseline WavLM | 0.0643 |
291+
292+
#### 🔁 Text-Audio
293+
294+
295+
| Rank | Team | F1-Macro |
296+
|------|-----------------------------------|----------|
297+
| 1 | Team NUST | 0.4611 |
298+
| 2 | alessiopittiglio | 0.4403 |
299+
| 3 | Baseline RoBERTa + WavLM | 0.3816 |
300+
| 4 | Team EvaAdriana | 0.3746 |
301+
| 5 | Baseline BiLSTM + MFCCs | 0.2191 |
302+
| 6 | Team CASS | 0.1432 |
303+
304+
---
305+
306+
### `AFD Task – Argumentative Fallacy Detection`
307+
308+
#### 📝 Text-only
309+
310+
311+
| Rank | Team | F1-Macro |
312+
|------|-----------------------------|----------|
313+
| 1 | Baseline RoBERTa | 0.2770 |
314+
| 2 | Ambali_Yashovardhan | 0.2534 |
315+
| 3 | Baseline BiLSTM | 0.2462 |
316+
| 4 | Team EvaAdriana | 0.2195 |
317+
318+
#### 🔊 Audio-only
319+
320+
321+
| Rank | Team | F1-Macro |
322+
|------|-----------------------------|----------|
323+
| 1 | Ambali_Yashovardhan | 0.2095 |
324+
| 2 | Team EvaAdriana | 0.1690 |
325+
| 3 | Baseline BiLSTM + MFCCs | 0.0000 |
326+
| 4 | Baseline WavLM | 0.0000 |
327+
328+
#### 🔁 Text-Audio
329+
330+
331+
| Rank | Team | F1-Macro |
332+
|------|-----------------------------------|----------|
333+
| 1 | Baseline RoBERTa + WavLM | 0.2848 |
334+
| 2 | Baseline BiLSTM + MFCCs | 0.2337 |
335+
| 3 | Ambali_Yashovardhan | 0.2244 |
336+
| 4 | Team EvaAdriana | 0.1931 |
337+
338+
264339
# Key Dates (Anywhere on Earth)
265340

266341
- **Release of Training Data**: February 25th

0 commit comments

Comments
 (0)