SemEval

International Workshop on Semantic Evaluation

What is SemEval?

SemEval is a series of international natural language processing (NLP) research workshops whose mission is to advance the current state of the art in semantic analysis and to help create high-quality annotated datasets in a range of increasingly challenging problems in natural language semantics. Each year's workshop features a collection of shared tasks in which computational semantic analysis systems designed by different teams are presented and compared.

SemEval is sponsored by the SIGLEX Special Interest Group on the Lexicon of the Association for Computational Linguistics. For more information on SemEval and its history, please see http://en.wikipedia.org/wiki/SemEval.

SemEval-2025

The call for task proposals is open!

SemEval-2024

The 18th edition of SemEval features 10 TASKS on a range of topics, including tasks on idiomaticy detection and embedding, sarcasm detection, multilingual news similarity, and linking mathematical symbols to their descriptions. Several tasks are multilingual, and others ask for multimodal approaches.

For all tasks, some sample data is already available. Take a look at the individual task websites for more detailed information.

SemEval-2023

Proceedings

Best task and paper awards

Recent Years

SemEval-2022

Proceedings

Best task and paper awards

SemEval-2021

Proceedings

Best task and paper awards

SemEval-2020

Proceedings

Best task and paper awards

Resources

Anti-Harassment policy

SemEval highly values the open exchange of ideas, freedom of thought and expression, and respectful scientific debate. We support and uphold the NAACL Anti-Harassment policy. Participants are encouraged to send any concerns or questions to the NAACL Board members, Priscilla Rasmussen and/or the workshop organizers.