Empowering the Fact-checkers! Automatic Identification of Claim Spans on Twitter

Organized by kshitijalwadhi - Current server time: Jan. 9, 2025, 9:07 a.m. UTC

First phase

Test
May 5, 2023, 6:29 p.m. UTC

End

Competition Ends
May 12, 2023, 9:29 p.m. UTC

Introduction

The shared task on "Empowering the Fact-checkers! Automatic Identification of Claim Spans on Twitter" invites participation in the following task:

  • Given a tweet text, classify whether it contains some facts and then label the spans containing the facts.

Important Dates

  • January 19, 2023: Release of the training set

  • May 11, 2023 (Might be changed): Release of the test set

More details can be referred from the paper: https://arxiv.org/pdf/2210.04710.pdf

For queries, please reach out to the following:

Kshitij Alwadhi: ee1190577@iitd.ac.in

Shivam Sharma: shivams@iiitd.ac.in

Claim Span Identification: Evaluation

Submission Details will be added here! (Stay Tuned)

  • Phase 1: development phase. We provide you with labeled training data and validation data. You can use these datasets for testing on your local machine.
  • Phase 2: final phase. Once you have validated your model locally, now you'll be making predictions on the test set and submitting them. Your performance on the test set will appear on the leaderboard when the organizers finish checking the submissions.

We'll be using token-F1 scores for evaluation. Here's a link to a jupyter notebook explaining the evaluation schema we'll be following in the autograder so that you can judge the performance on your dev sets: https://drive.google.com/file/d/1VhYGm4ADax6ak1ZxgtYOGVlEeIFRGmpY/view?usp=sharing

Claim Span Identification: Rules

You are not required to make any submissions during the development phase.

Submissions must be made before the end of the testing phase. You may submit 5 submissions every day and 100 in total.

Test

Start: May 5, 2023, 6:29 p.m.

Description: Final Phase: create models and submit predictions on the test data. Your performance will be displayed on the leaderboard

Competition Ends

May 12, 2023, 9:29 p.m.

You must be logged in to participate in competitions.

Sign In