We are pleased to announce the following tasks for SemEval-2027!

TASKS

Websites and contact information for individual tasks will be given below soon.

Reasoning and Inference

• Task 1: RETECO: A SemEval-2027 Shared Task on Reasoning-Oriented Retrieval ([contact organizers])
  Abdelrahman Abdallah, Mohammed Ali, Muhammad Abdul-Mageed, Kevin Duh and Adam Jatowt.

• Task 2: Coherence-Aware Compositional Fine Grained Natural Language Inference (CoCo-NLI) ([contact organizers])
  Jon Felix Apaolaza Larraya, Aitor Soroa, Rodrigo Agerri and Inigo Lopez-Gazpio

Lexical and Compositional Semantics

• Task 3: Meaning Change Across Multiple Time Periods ([contact organizers])
  Nina Tahmasebi, Pierluigi Cassotti, Felix Morger, Lucia Siciliani, Pablo Mosteiro, Stefano De Pascale and Mariia Fedorova

• Task 4: Par-PARSEME: A Multilingual Shared Task on Paraphrasing of Idioms ([contact organizers])
  Carlos Ramisch, Manon Scholivet, Agata Savary, Takuya Nakamura and Eric Bilinski

• Task 5: ComPartMENT - Noun Compound and Particle Verb Compositionality Prediction in Context ([contact organizers])
  Filip Miletić, Chris W. Jenkins and Sabine Schulte im Walde

Cultural and Cross-Lingual Understanding

• Task 6: Multilingual and Multimodal Culturally Grounded Spoken and Visual Question Answering ([contact organizers])
  Firoj Alam, Shammur Absar Chowdhury, Md Arid Hasan, Nadir Durrani, Fahim Dalvi, Ebru Arisoy and Usman Naseem

• Task 7: CLaS: Cross-Lingual Alignment and Steering of Large Language Models ([contact organizers])
  Daniil Gurgurov, Tanja Baeumel, Dana Arad, Anastasiia Sedova, Masha Fedzechkina, Josef van Genabith, Patrick Schramowski, Marius Mosbach and Simon Ostermann

Stereotypes, Framing, and Sentiment Analysis

• Task 8: StereoQueerEval: Identification of Stereotypes and Hate Speech Targeting the LGBTQIA+ Community ([contact organizers])
  Alessandra Teresa Cignarella, Greta Damo, Marta Marchiori Manerba, Marzieh Abdolmaleki, Els Lefever and Debora Nozza

• Task 9: Analysis of Multimodal Framing in the News ([contact organizers])
  Jakub Piskorski, Giovanni Da San Martino, Dimitar Iliyanov Dimitrov, Yova Kementchedjhieva, Ricardo Campos, Alipio Mario Jorge, Preslav Nakov, Lidia Pivovarova and Roman Yangarber

Emerging Topics: Agents and AI Tools

• Task 10: AgentRisk: Risk Evaluation, Identification, and Policy-Guided Response in Agentic Multi-Turn Interactions ([contact organizers])
  Orfeas Menis Mastromichalakis, Anna (Ruoxi) Shang, Giorgos Filandrianos, Angelos Vlachos, Chrysoula Zerva, Emmanouil Koukoumidis and André Martins

• Task 11: VAKRA-Advanced: Evaluating Multi-Hop Multi-Source tool-calling capabilities in Executable Environments ([contact organizers])
  Ankita Rajaram Naik, Anupama Narasimha Murthi, Benjamin T. Elder, Siyu Huo, Praveen Venkateswaran, Abdulhamid Adebayo, Sara Rosenthal and Danish Contractor

CONTACT

For questions about particular tasks, email the task organizers at the addresses linked above. General questions about SemEval organization should be directed to semevalorganizers@gmail.com.

For general information about participating in SemEval and submitting papers, see Resources.

Link to CodaLab instructions, for both organizers and participants.