NeurIPS 2022 CausalML Challenge: Causal Insights for Learning Paths in Education Forum

Go back to competition Back to thread list Post in this thread

> [Important] Announcements from the organisers

Dear participants,

Finally, we reached the end stage of the competition!
Here are some announcements before the end of the competition.

(1) We spotted a potential problem in the evaluation for task 3, and it has been fixed now. We are sorry for any inconvenience. We have re-evaluated all submissions for task 3 in the backend, and the current rankings are correct. However, we strongly suggest the participants re-submit their latest results to both public and private leaderboards.

Due to this, we extend the competition by one week, which will end at 29 Oct 2022 midnight UTC.

(2) We also notice that the number of submissions for the private leaderboard is much fewer than the public leaderboard for all 4 tasks. Remind that we only use the submissions in the private leaderboard for choosing the winners, and we also have an additional prize for the best performing team for all 4 tasks.

(3) Last but not least, we re-emphasise the following just in case the participants ignore it in the instruction documents. The score 0 for task 3 and 4 in public leaderboard DOES NOT mean the actual submission is bad. To avoid overfitting to the public score, we deliberately multiply the actual score by a small constant so that it won’t show up in the leaderboard. But, the ranking is correct and based on the actual scores.

Best,

Organizers

Posted by: WenboGong @ Oct. 19, 2022, 5:02 p.m.
Post in this thread