Competition

AraFinNLP SharedTask 2024 (Subtask 1 - Multi-dialect Intent Detection)

Organized by Sanad - Current server time: May 4, 2024, 8:56 a.m. UTC

Previous

Development
April 5, 2024, midnight UTC

Current

Test
April 25, 2024, midnight UTC

Next

Post-Evaluation
May 10, 2024, midnight UTC

Development

Start: April 5, 2024, midnight

Description: Development phase: Develop your models and submit prediction labels on the DEV set of subtask 1. Note: The name of your submission should be 'teamname_subtask1_dev_pred_numberOFsubmission.zip' that includes a csv file of your prediction. Also, the submission file should include the substring _pred_ in the filename (e.g., A submission 'BZU_subtask1_dev_pred_1.zip' that is the zip file of my first prediction, 'BZU_subtask1_dev_pred_1.csv'.). Your submission should only have "QueryID" and "IntentID" columns that contain the query and intent identifiers respectively. Make sure that your submission has the same number of lines as the Dev set.

Test

Start: April 25, 2024, midnight

Description: Test phase: Submit your prediction labels on the TEST set of subtask 1. Each team is allowed a maximum of 5 submissions. Note: The name of your submission should be 'teamname_subtask1_test_pred_numberOFsubmission.zip' that includes a csv file of your predictions. Also, the submission file should include the substring _pred_ in the filename (e.g., A submission 'BZU_subtask1_test_pred_1.zip' that is the zip file of my prediction, 'BZU_subtask1_test_pred_1.csv'.). Your submission should only have "QueryID" and "IntentID" columns that contain the query and intent identifiers respectively. Make sure that your submission has the same number of lines as the Test set.

Post-Evaluation

Start: May 10, 2024, midnight

Description: Post-Evaluation: Submit your prediction labels on the TEST set of subtask 1. Each team is allowed a maximum of 3 submissions. Note: The name of your submission should be 'teamname_subtask2_test_pred_numberOFsubmission.zip' that includes a text file of your predictions. Also, the submission file should include the substring _pred_ in the filename (e.g., A submission 'BZU_subtask2_test_pred_1.zip' that is the zip file of my prediction, 'BZU_subtask2_test_pred_1.json'.)

Competition Ends

June 10, 2024, 11 p.m.

You must be logged in to participate in competitions.

Sign In
# Username Score
1 murhaf 0.85564
2 Hossam-Elkordi 0.84822
3 sultan 0.83423