International Workshop on Semantic Evaluation

What is SemEval?

SemEval is a series of international natural language processing (NLP) research workshops whose mission is to advance the current state of the art in semantic analysis and to help create high-quality annotated datasets in a range of increasingly challenging problems in natural language semantics. Each year's workshop features a collection of shared tasks in which computational semantic analysis systems designed by different teams are presented and compared.

SemEval is sponsored by the SIGLEX Special Interest Group on the Lexicon of the Association for Computational Linguistics. For more information on SemEval and its history, please see


The 15th edition of SemEval features tasks ranging from prediction of lexical complexity to learning with disagreements, and including several cross-lingual and multi-modal tasks.

The evaluation period took place in January 2021. See the SemEval-2021 homepage for details.

The workshop took place virtually on August 5–6, 2021, colocated with ACL-IJCNLP 2021.





The 16th edition of SemEval features 12 TASKS on a range of topics, including tasks on idiomaticy detection and embedding, sarcasm detection, multilingual news similarity, and linking mathematical symbols to their descriptions. Several tasks are multilingual, and others ask for multimodal approaches.

Trial data for most tasks is already available, and full training data will be released by early September. Take a look at the individual task websites for more detailed information.

Previous Years



Best task and paper awards


Anti-Harassment policy

SemEval highly values the open exchange of ideas, freedom of thought and expression, and respectful scientific debate. We support and uphold the NAACL Anti-Harassment policy. Participants are encouraged to send any concerns or questions to the NAACL Board members, Priscilla Rasmussen and/or the workshop organizers.