We are pleased to announce the following tasks for SemEval-2024!

TASKS

Websites and contact information for individual tasks will be given below soon.

Semantic Relations

• Task 1: Semantic Textual Relatedness for African and Asian Languages ([contact organizers], [join task mailing list])
  Nedjma OUSIDHOUM, Shamsuddeen Hassan Muhammad, Mohamed Abdalla, Krishnapriya Vishnubhotla, Vladimir Araujo, Meriem Beloucif, Idris Abdulmumin, Seid Muhie Yimam, Thamar Solorio, Monojit Choudhury, Saif M. Mohammad

• Task 2: Safe Biomedical Natural Language Inference for Clinical Trials ([contact organizers], [join task mailing list])
  Mael Jullien, Marco Valentino, Andre Freitas

Discourse and Argumentation

• Task 3: The Competition of Multimodal Emotion Cause Analysis in Conversations ([contact organizers], [join task mailing list])
  Rui Xia, Jianfei Yu, Fanfan Wang, Erik Cambria

• Task 4: Multilingual Detection of Persuasion Techniques in Memes ([contact organizers], [join task mailing list])
  Dimitar Iliyanov Dimitrov, Giovanni Da San Martino, Fabrizio Silvestri, Preslav Nakov, Firoj Alam

• Task 5: Argument Reasoning in Civil Procedure ([contact organizers], [join task mailing list])
  Lena Held, Ivan Habernal

LLM Capabilities

• Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes ([contact organizers], [join task mailing list])
  Elaine Zosa, Raúl Vázquez, Jörg Tiedemann, Vincent Segonne, Alessandro Raganato, Timothee Mickus, Marianna Apidianaki

• Task 7: NumEval: Numeral-Aware Language Understanding and Generation ([contact organizers], [join task mailing list])
  Chung-Chi Chen, Hen-Hsen Huang, Hiroya Takamura, Hsin-Hsi Chen

• Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detection ([contact organizers], [join task mailing list])
  Yuxia Wang, Alham Fikri Aji, Artem Shelmanov, Chenxi Whitehouse, Petar Ivanov, Jonibek Mansurov, Jinyan Su, Tarek Mahmoud, Osama Mohammed Afzal, Preslav Nakov

Knowledge Representation and Reasoning

• Task 9: BRAINTEASER: A Novel Task Defying Common Sense ([contact organizers], [join task mailing list])
  Yifan Jiang, Filip Ilievski, Kaixin Ma

• Task 10: Emotion Discovery and Reasoning its Flip in Conversation ([contact organizers], [join task mailing list])
  Shivani Kumar, Md Shad Akhtar, Tanmoy Chakraborty, Erik Cambria

CONTACT

For questions about particular tasks, email the task organizers at the addresses linked above. General questions about SemEval organization should be directed to semevalorganizers@gmail.com.

For general information about participating in SemEval and submitting papers, see Resources.

Link to CodaLab instructions, for both organizers and participants.