Lexical Semantic Change Discovery Shared Task

Organized by fdzr - Current server time: May 24, 2022, 3:46 p.m. UTC

First phase

Development Phase 1 (Graded Discovery)
Feb. 28, 2022, midnight UTC

End

Competition Ends
March 31, 2022, noon UTC

Development Phase 1 (Graded Discovery)

Start: Feb. 28, 2022, midnight

Description: The target words correspond to the content word (adjectives, adverbs, verbs and nouns) vocabulary intersection between the two lemmatized corpora above a frequency threshold. The frequency threshold is 40 and 73 for corpus 1 and 2 respectively. Uploaded submissions will be scored against 20 hidden words from the full target word list which were annotated for semantic change. Please submit a Zip archive called answer.zip with a file named submission.tsv with the right format for this phase. You can upload as many submissions as you can.

Development Phase 2 (Binary Detection)

Start: March 9, 2022, midnight

Description: The target words correspond to the 20 hidden words from Phase 1. Participants get access to the annotated usages (20+20 from each corpus), human annotations and gold change scores for development. Uploaded submissions will be scored against the 20 target words. Please submit a Zip archive called answer.zip with a file named submission.tsv with the right format for this phase. You can upload as many submissions as you can. The evaluation script for phase 2 ignores additional words other than the target words as input in phase 2.

Evaluation Phase 1 (Graded Discovery)

Start: March 14, 2022, midnight

Description: The target words correspond to the content word (adjectives, adverbs, verbs and nouns) vocabulary intersection between the two lemmatized corpora above a frequency threshold. The frequency threshold is 40 and 73 for corpus 1 and 2 respectively. Uploaded submissions will be scored against 60 hidden words from the full target word list which were annotated for semantic change. Please submit a Zip archive called answer.zip with a file named submission.tsv with the right format for this phase. You can only upload 3 submissions.

Evaluation Phase 2 (Binary Detection)

Start: March 22, 2022, midnight

Description: The target words correspond to the 60 hidden words from Phase 1. Participants get access to the annotated usages (20+20 from each corpus). Uploaded submissions will be scored against the 60 target words. Please submit a Zip archive called answer.zip with a file named submission.tsv with the right format for this phase. You can only upload 3 submissions. The evaluation script for phase 2 ignores additional words other than the target words as input in phase 2.

Competition Ends

March 31, 2022, noon

You must be logged in to participate in competitions.

Sign In