CLEF2022 CheckThat! Lab - Task 2
Organized by firojalam - Current server time: Nov. 26, 2025, 5:39 p.m. UTC
First phase
Subtask-2A-English--EvaluationApril 22, 2022, midnight UTC
End
Competition EndsMay 6, 2022, 11:59 p.m. UTC
Task 2: Detecting Previously Fact-Checked Claims
Task definition: Given a check-worthy claim in the form of a tweet, and a set of previously fact-checked claims, rank the previously fact-checked claims in order of usefulness to fact-check the input claim. You can find all the details for the dataset, format checker, scorer and baselines from this CLEF2022-CheckThat! Task 2, for the git repo.
The current version are listed bellow corresponds to the release of the training, dev and test sets.
You can find all the dataset,
The leaderboard is now publicly available at http://shorturl.at/dzX28 sheet (task 2).
Evaluation Metrics
This task is evaluated as a ranking task. Ranked list per claim will be evaluated using ranking evaluation measures (MAP@k for k=1,3,5,10,20,all, MRR and Precision@k for k=1,3,5,10,20). Official measure is MAP@5.
Baselines
The baselines module contains a random and a simple BM25 IR baseline for the task.
| Model | subtask-2A--English | subtask-2A--Arabic | subtask-2B--English |
|---|---|---|---|
| Random Baseline | 0.0000 | 0.0000 | |
| Ngram Baseline | 0.8179 | 0.3207 |
Submission Guidelines
- Make sure that you create one account for each team, and submit it through one account only.
- We will keep the leaderboard private till the end of the submission period, hence, results will not be available upon submission. All results will be available after the evaluation period.
- You are allowed to submit max 200 submissions per day for each subtask.
- The last file submitted to the leaderboard will be considered as the final submission.
- The output file has to have a `.tsv` extension; otherwise, you will get an error on the leaderboard.
- You need to write a small description of the model submitted in a `.txt` file.
- You have to zip the tsv, `zip submission.zip path_to_tsv_file.tsv model_description.txt` and submit it through the codalab page.
Terms and Conditions
This page enumerated the terms and conditions of the competition.
No files have been added for this competition yet.
Subtask-2A-English--Evaluation
Start: April 22, 2022, midnight
Description: Subtask-2A-English--Evaluation
Subtask-2B-English--Evaluation
Start: April 22, 2022, midnight
Description: Subtask-2B-English--Evaluation
Subtask-2A-Arabic--Evaluation
Start: April 22, 2022, midnight
Description: Subtask-2A-Arabic--Evaluation
Competition Ends
May 6, 2022, 11:59 p.m.
You must be logged in to participate in competitions.
Sign In