View on GitHub

SemEval-2025

The 19th International Workshop on Semantic Evaluation

SemEval-2025: Best Task, Best Papers!!

SemEval-2025 features several overall awards: one for organizers of a task, one for the best team participating in a task, and awards for the best team participants in each task.

We are very pleased to announce the winners of these awards for SemEval-2025!

Best Task Paper Award

The Best Task Paper award, for organizers of an individual shared task, recognizes a task that stands out for making an important intellectual contribution to empirical computational semantics, as demonstrated by a creative, interesting, and scientifically rigorous dataset and evaluation design, and a well-written task overview paper.

Best Task Paper: SemEval 2025 Task 11: Bridging the Gap in Text-Based Emotion Detection
Shamsuddeen Hassan Muhammad, Nedjma Ousidhoum, Idris Abdulmumin, Seid Muhie Yimam, Jan Philip Wahle, Terry Lima Ruas, Meriem Beloucif, Christine de Kock, Tadesse Destaw Belay, Ibrahim Said Ahmad, Nirmal Surange, Daniela Teodorescu, David Ifeoluwa Adelani, Alham Fikri Aji, Felermino Dario Mario Ali, Vladimir Araujo, Abinew Ali Ayele, Oana Ignat, Alexander Panchenko, Yi Zhou, Saif M. Mohammad

Best System Paper Award

The Best System Paper award, for task participants, recognizes a system description paper that advances our understanding of a problem and available solutions with respect to a task. It need not be the highest-scoring system in the task, but it must have a strong analysis component in the evaluation, as well as a clear and reproducible description of the problem, algorithms, and methodology.

Best System Paper: AILS-NTUA at SemEval-2025 Task 4: Parameter-Efficient Unlearning for Large Language Models using Data Chunking
Iraklis Premptis, Maria Lymperaiou, George Filandrianos, Orfeas Menis Mastromichalakis, Athanasios Voulodimos, Giorgos Stamou

Honorable Mention: PALI-NLP at SemEval 2025 Task 1: Multimodal Idiom Recognition and Alignment
Runyang You, Xinyue Mei, Mengyuan Zhou

Best System Paper per Task Award

The Best System Paper per task award, for task participants, recognizes the system description papers that advances our understanding of a problem and available solutions with respect to each SemEval task. They need not be the highest-scoring system in their task, but they must have a strong analysis component in the evaluation, as well as a clear and reproducible description of the problem, algorithms, and methodology.

Best System Paper Task 1: PALI-NLP at SemEval 2025 Task 1: Multimodal Idiom Recognition and Alignment
Runyang You, Xinyue Mei, Mengyuan Zhou

Best System Paper Task 2: SALT🧂 at SemEval-2025 Task 2: A SQL-based Approach for LLM-Free Entity-Aware-Translation
Tom VÃlker, Jan Pfister, Andreas Hotho

Best System Paper Task 3: UCSC at SemEval-2025 Task 3: Context, Models and Prompt Optimization for Automated Hallucination Detection in LLM Output
Sicong Huang, Jincheng He, Shiyuan Huang, Karthik Raja Anandan, Arkajyoti Chakraborty, Ian Lane

Best System Paper Task 4: AILS-NTUA at SemEval-2025 Task 4: Parameter-Efficient Unlearning for Large Language Models using Data Chunking
Iraklis Premptis, Maria Lymperaiou, George Filandrianos, Orfeas Menis Mastromichalakis, Athanasios Voulodimos, Giorgos Stamou

Best System Paper Task 5: DNB-AI-Project at SemEval-2025 Task 5: An LLM-Ensemble Approach for Automated Subject Indexing
Lisa Kluge, Maximilian Kähler

Best System Paper Task 6: CSCU at SemEval-2025 Task 6: Enhancing Promise Verification with Paraphrase and Synthesis Augmentation: Effects on Model Performance
Kittiphat Leesombatwathana, Wisarut Tangtemjit, Dittaya Wanvarie

Best System Paper Task 7: RACAI at SemEval-2025 Task 7: Efficient adaptation of Large Language Models for Multilingual and Crosslingual Fact-Checked Claim Retrieval
Radu-Gabriel Chivereanu, Dan Tufis

Best System Paper Task 8: Samsung Research Poland at SemEval-2025 Task 8: LLM ensemble methods for QA over tabular data
Pawel Bujnowski, Tomasz Dryjanski, Christian Goltz, Bartosz Swiderski, Natalia Paszkiewicz, Bartlomiej Kuzma, Jacek Rutkowski, Jakub Stepka, Milosz Dudek, Wojciech Siemiatkowski, Weronika Plichta, Bartłomiej Paziewski, Maciej Grabowski, Katarzyna Beksa, Zuzanna Bordzicka, Filip Ostrowski, Grzegorz Sochacki

Best System Paper Task 9: BitsAndBites at SemEval-2025 Task 9: Improving Food Hazard Detection with Sequential Multitask Learning and Large Language Models
Aurora Gensale, Irene Benedetto, Luca Gioacchini, Luca Cagliero, Alessio Bosca

Best System Paper Task 10: DUTIR at SemEval-2025 Task 10: A Large Language Model-based Approach for Entity Framing in Online News
Tengxiao Lv, Juntao Li, Chao Liu, Yiyang Kang, Ling Luo, Yuanyuan Sun, Hongfei LIN

Best System Paper Task 11: JNLP at SemEval-2025 Task 11: Cross-Lingual Multi-Label Emotion Detection Using Generative Models
Jieying XUE, Phuong Minh Nguyen, Minh Le Nguyen, XIN LIU