Competition

AraFinNLP SharedTask 2024 (Subtask 1 - Multi-dialect Intent Detection)

Organized by Sanad - Current server time: Dec. 21, 2024, 3:09 p.m. UTC

Previous

Post-Evaluation
May 13, 2024, 11:59 p.m. UTC

Current

Post-Evaluation
May 13, 2024, 11:59 p.m. UTC

End

Competition Ends
June 10, 2024, 11 p.m. UTC

Development

Start: April 5, 2024, midnight

Description: Development phase: Develop your models and submit prediction labels on the DEV set of subtask 1. Note: The name of your submission should be 'teamname_subtask1_dev_pred_numberOFsubmission.zip' that includes a csv file of your prediction. Also, the submission file should include the substring _pred_ in the filename (e.g., A submission 'BZU_subtask1_dev_pred_1.zip' that is the zip file of my first prediction, 'BZU_subtask1_dev_pred_1.csv'.). Your submission should only have "QueryID" and "IntentID" columns that contain the query and intent identifiers respectively. Make sure that your submission has the same number of lines as the Dev set.

Test

Start: April 25, 2024, midnight

Description: Test phase: Submit your prediction labels on the TEST set of subtask 1. Each team is allowed a maximum of 5 submissions. Note: The name of your submission should be 'teamname_subtask1_test_pred_numberOFsubmission.zip' that includes a csv file of your predictions. Also, the submission file should include the substring _pred_ in the filename (e.g., A submission 'BZU_subtask1_test_pred_1.zip' that is the zip file of my prediction, 'BZU_subtask1_test_pred_1.csv'.). Your submission should only have "QueryID" and "IntentID" columns that contain the query and intent identifiers respectively. Make sure that your submission has the same number of lines as the Test set.

Post-Evaluation

Start: May 13, 2024, 11:59 p.m.

Description: Post-Evaluation: This phase help you calculate Precision, Recall, and Accuracy scores in addition to the F1-Score. Please only submit your best submission that appears on the leaderboard of the TEST phase of subtask 1. Note: The name of your submission should be 'teamname_subtask1_test_pred_numberOFsubmission.zip' that includes a text file of your predictions. Also, the submission file should include the substring _pred_ in the filename (e.g., A submission 'BZU_subtask1_test_pred_1.zip' that is the zip file of my prediction, 'BZU_subtask1_test_pred_1.csv'.)

Competition Ends

June 10, 2024, 11 p.m.

You must be logged in to participate in competitions.

Sign In
# Username Score
1 murhaf 0.85283
2 AsmaaRamadan 0.83022
3 Roronoa_Zoro 0.66266