Lexical Semantic Change Discovery Shared Task
Organized by fdzr - Current server time: Dec. 21, 2024, 2:46 p.m. UTC
First phase
Development Phase 1 (Graded Discovery)Feb. 28, 2022, midnight UTC
End
Competition EndsMarch 31, 2022, noon UTC
Development Phase 1 (Graded Discovery)
Start: Feb. 28, 2022, midnight
Description: The target words correspond to the content word (adjectives, adverbs, verbs and nouns) vocabulary intersection between the two lemmatized corpora above a frequency threshold. The frequency threshold is 40 and 73 for corpus 1 and 2 respectively. Uploaded submissions will be scored against 20 hidden words from the full target word list which were annotated for semantic change. Please submit a Zip archive called answer.zip with a file named submission.tsv with the right format for this phase. You can upload as many submissions as you can.
Development Phase 2 (Binary Detection)
Start: March 9, 2022, midnight
Description: The target words correspond to the 20 hidden words from Phase 1. Participants get access to the annotated usages (20+20 from each corpus), human annotations and gold change scores for development. Uploaded submissions will be scored against the 20 target words. Please submit a Zip archive called answer.zip with a file named submission.tsv with the right format for this phase. You can upload as many submissions as you can. The evaluation script for phase 2 ignores additional words other than the target words as input in phase 2.
Evaluation Phase 1 (Graded Discovery)
Start: March 14, 2022, midnight
Description: The target words correspond to the content word (adjectives, adverbs, verbs and nouns) vocabulary intersection between the two lemmatized corpora above a frequency threshold. The frequency threshold is 40 and 73 for corpus 1 and 2 respectively. Uploaded submissions will be scored against 60 hidden words from the full target word list which were annotated for semantic change. Please submit a Zip archive called answer.zip with a file named submission.tsv with the right format for this phase. You can only upload 3 submissions.
Evaluation Phase 2 (Binary Detection)
Start: March 22, 2022, midnight
Description: The target words correspond to the 60 hidden words from Phase 1. Participants get access to the annotated usages (20+20 from each corpus). Uploaded submissions will be scored against the 60 target words. Please submit a Zip archive called answer.zip with a file named submission.tsv with the right format for this phase. You can only upload 3 submissions. The evaluation script for phase 2 ignores additional words other than the target words as input in phase 2.
Competition Ends
March 31, 2022, noon
You must be logged in to participate in competitions.
Sign In