Cross-Domain MetaDL
Organized by dustinc - Current server time: Nov. 21, 2024, 11:24 a.m. UTC
Reward $4,000
Reward $4,000
First phase
FeedbackJuly 1, 2022, 11:59 p.m. UTC
End
Competition EndsOct. 15, 2022, 11:59 p.m. UTC
Feedback
Start: July 1, 2022, 11:59 p.m.
Description: Participants can make 2 submissions per day and a maximum of 100 submissions during the whole phase. Each submission will be evaluated on 1000 any-way any-shot tasks carved out from 10 datasets (100 tasks per dataset) different than the ones used for meta-training (Public data). Additionally, each submission cannot take more than 5 hours of running time. During this phase, the normalized classification accuracy over all tasks, the normalized classification accuracy per dataset, and the total execution time will be displayed on the Competition Leaderboard.
Final
Start: Sept. 1, 2022, 11:59 p.m.
Description: The participants are not allowed to make submissions; instead, their last submission on the Feedback phase will be automatically forwarded to this phase, and the allowed running time will increase to 9 hours maximum due to the increment of meta-test tasks. The forwarded submission will be evaluated on 6000 any-way any-shot tasks carved out from 10 fresh datasets (600 tasks per dataset), i.e., not seen in either the Public phase or the Feedback phase. During this phase, all submissions will be run three times with various random seeds, and the worst normalized classification accuracy over all meta-test tasks will be used for the final ranking.
Competition Ends
Oct. 15, 2022, 11:59 p.m.
You must be logged in to participate in competitions.
Sign In