Competitions

SemEval 2025 Task 9 - The Food Hazard Detection Challenge

Organized by food-hazard-detection-semeval-2025

The Food Hazard Detection task evaluates explainable classification systems for titles of food-incident reports collected from the web. These algorithms ...

SHROOM - a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes

Organized by tmickus

SemEval 2024 Task 6 - Detecting hallucinations in NLG outputs

EDiReF - SemEval 2024 Task 10

Organized by shivaniku

The EDiReF shared task at SemEval 2024 is an amalgamation of three subtasks tasks- (i) Emotion Recognition in Conversation (ERC) ...

Semantic Textual Relatedness (STR) - SemEval 2024 Task 1 (Post-Evaluation)

Organized by abumafrim

Participants will rank sentence pairs by their closeness in meaning (i.e., their degree of semantic relatedness) in 14 languages predominantly ...

ECAC (SemEval-2024 Task 3)

Organized by Fan1834

The Competition of Multimodal Emotion Cause Analysis in Conversations

SemEval 2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trials

Organized by MJ2301

Textual entailment over breast cancer clinical trial reports.

Semantic Textual Relatedness (STR) - SemEval 2024 Task 1 (Development Phase)

Organized by abumafrim

Participants will rank sentence pairs by their closeness in meaning (i.e., their degree of semantic relatedness) in 14 languages predominantly ...

Semeval 2024 Task9 BRAINTEASER-A Novel Task Defying Common Sense

Organized by YifanJiang

A multiple-choice Question-answering task designed to test the model's ability to exhibit lateral thinking and defy default commonsense associations.

SemEval-2024 Task 5 Argument Reasoning in Civil Procedure

Organized by lena.held

Given a question with a possible correct answer and a short introduction to the topic of the question, identify if ...

MultiCoNER II: SemEval-2023 Task 2 (Evaluation Phase)

Organized by multiconer

SemEval-2023 task to develop NER systems for complex entities across 12 languages.

SemEval 2023 Task 7- Multi-evidence Natural Language Inference for Clinical Trial Data

Organized by MJ2301

Textual entailment and evidence retrieval over breast cancer clinical trial reports.

MultiCoNER II: SemEval-2023 Task 2 (Practice Phase)

Organized by multiconer

SemEval-2023 task to develop NER systems for complex entities across 12 languages.

Multilingual Tweet Intimacy Analysis

Organized by pedropei

SemEval 2023 Task 9: Multilingual Tweet Intimacy Analysis [ALERT] You might see offensive or sexual content in the dataset.

AfriSenti-SemEval 2023 Shared Task 12

Organized by abumafrim

Sentiment classification in 14 African languages. Task (A), monolingual; Task (B), multilingual sentiment; and Task (C) zero-shot classification. There is ...

SemEval 2023 - Task 10 - Explainable Detection of Online Sexism (EDOS)

Organized by hannah.rose.kirk

Detect binary sexism (Task A), 4-way sexism category (Task B) and 11-way sexism vector (Task C).

SemEval-2023: Visual Word Sense Disambiguation (VisualWSD)

Organized by asahi417

Part of the 17th International Workshop on Semantic Evaluation.

Task11 @SemEval2023: Learning With Disagreements (Le-Wi-Di), 2nd edition

Organized by elisa.leonardelli

A SemEval2023 shared task on learning to classify with datasets containing disagreements

SemEval 2022 - Task 6 (iSarcasmEval) : Intended Sarcasm Detection In English and Arabic

Organized by iabufarha

Intended Sarcasm Detection In English and Arabic

PreTENS SemEval22 Task3 (SubTask2)

Organized by aridhasan

PreTENS SemEval22 Task3 (SubTask1)

Organized by aridhasan

SemEval 2022 Task 2 - Post-Evaluation

Organized by tmharish

Competition Website for SemEval 2022 Task 2 - Multilingual Idiomaticity Detection and Sentence Embedding

SemEval-2019 Task 12 - Toponym Resolution in Scientific Papers

Organized by ivanflores

This challenge on toponym resolution, also known as geoparsing, geo-grounding or place name resolution, aims to assign geographic coordinates to ...