SemEval 2023 - Task 10 - Explainable Detection of Online Sexism (EDOS) Forum

Go back to competition Back to thread list Post in this thread

> Will task B and C dev data have any non-sexist posts?

I am assuming they won't, but let us know if they do please.

Posted by: vitthal @ Dec. 26, 2022, 1:03 a.m.


There will be no "non-sexist" entries in Task B and Task C. This is why we're releasing the test data in two stages (TASK A) then (TASK B and C).

Posted by: hannah.rose.kirk @ Dec. 26, 2022, 11:14 a.m.

then, what is the label for not sexist tweets in task B in development phase to get the metrics?

Posted by: I2C_Huelva @ Jan. 10, 2023, 10:33 a.m.

To clarify:
(1) You will not submit any label for non-sexist tweets in Task B because they won't be an entry in Task B. Task B (& C) only contains the entries which are the sexist subset of Task A. Macro-F1 score (our evaluation metric) for Task B & C is only calculated over sexist tweets.
(2) We are releasing the dev set labels for Task A, B and C later today as per our most recent announcement.

Does that answer your question?

Posted by: hannah.rose.kirk @ Jan. 10, 2023, 11:55 a.m.
Post in this thread