I am assuming they won't, but let us know if they do please.
Posted by: vitthal @ Dec. 26, 2022, 1:03 a.m.Hi,
There will be no "non-sexist" entries in Task B and Task C. This is why we're releasing the test data in two stages (TASK A) then (TASK B and C).
Posted by: hannah.rose.kirk @ Dec. 26, 2022, 11:14 a.m.then, what is the label for not sexist tweets in task B in development phase to get the metrics?
Posted by: I2C_Huelva @ Jan. 10, 2023, 10:33 a.m.To clarify:
(1) You will not submit any label for non-sexist tweets in Task B because they won't be an entry in Task B. Task B (& C) only contains the entries which are the sexist subset of Task A. Macro-F1 score (our evaluation metric) for Task B & C is only calculated over sexist tweets.
(2) We are releasing the dev set labels for Task A, B and C later today as per our most recent announcement.
Does that answer your question?
Posted by: hannah.rose.kirk @ Jan. 10, 2023, 11:55 a.m.