Competition

ArAIEval shared task at WANLP 2023 - Evaluation Phase

Organized by maramhasanain - Current server time: Aug. 22, 2025, 4:34 a.m. UTC

First phase

Subtask-2A-Binary-Disinformation
Aug. 14, 2023, 8 a.m. UTC

End

Competition Ends
Aug. 21, 2023, noon UTC

ArAIEval shared task at WANLP 2023

You can find all the details for the dataset, format checker, scorer and baselines from this ArAIEval git repo.

This leaderboard contains the basic information regarding the ArAIEval shared task at WANLP2023:

  • Task 1: persuasion technique detection in multi-genre Arabic textual content including tweets and paragraphs from news Articles.
  • Task 2: disinformation detection in Arabic tweets.

Datasets

Evaluation Metrics

The official evaluation metric is micro F_1 for all subtasks.

Baselines

Task 1 baselines module contains a random baseline for each subtask.

Task 2 baselines module contains a random baseline for each subtask.

Submission Guidelines

  • Each team should create and maintain a single account for submissions. Please ensure all runs are submitted through this account. Submissions from multiple accounts by the same team could result in your system being not ranked in the overview paper.
  • The most recent file submitted to the leaderboard will be considered your final submission.
  • The output file must be named task[1/2][A/B]_any_suffix.tsv, where [1/2] is the task number and A/B is your specific subtask (for example, task1A_team_name.tsv or task2B_team_name.tsv). Failure to follow this naming convention will result in an error on the leaderboard. Subtasks include 1A, 1B, 2A and 2B.
  • You are required to compress the .tsv file into a .zip file (for example, zip task1B.zip task1B.tsv) and submit it via the Codalab page.
  • Please include your team name and a description of your method with each submission.
  • You are permitted to submit a maximum of 200 submissions per day for each subtask.

Subtask-2A-Binary-Disinformation

Start: Aug. 14, 2023, 8 a.m.

Description: Subtask-2A-Binary-Disinformation

Subtask-2B-Multiclass-Disinformation

Start: Aug. 14, 2023, 8 a.m.

Description: Subtask-2B-Multiclass-Disinformation

Subtask-1B-Multilabel-Persuasion-Technique

Start: Aug. 14, 2023, 8 a.m.

Description: Subtask-1B-Multilabel-Persuasion-Technique

Subtask-1A-Binary-Persuasion-Technique

Start: Aug. 14, 2023, 8 a.m.

Description: Subtask-1A-Binary-Persuasion-Technique

Competition Ends

Aug. 21, 2023, noon

You must be logged in to participate in competitions.

Sign In