Cross-Domain MetaDL

Organized by dustinc - Current server time: Nov. 28, 2022, 3:47 p.m. UTC
Reward $4,000

First phase

Feedback
July 1, 2022, 11:59 p.m. UTC

End

Competition Ends
Oct. 15, 2022, 11:59 p.m. UTC

Feedback

Start: July 1, 2022, 11:59 p.m.

Description: Participants can make 2 submissions per day and a maximum of 100 submissions during the whole phase. Each submission will be evaluated on 1000 any-way any-shot tasks carved out from 10 datasets (100 tasks per dataset) different than the ones used for meta-training (Public data). Additionally, each submission cannot take more than 5 hours of running time. During this phase, the normalized classification accuracy over all tasks, the normalized classification accuracy per dataset, and the total execution time will be displayed on the Competition Leaderboard.

Final

Start: Sept. 1, 2022, 11:59 p.m.

Description: The participants are not allowed to make submissions; instead, their last submission on the Feedback phase will be automatically forwarded to this phase, and the allowed running time will increase to 9 hours maximum due to the increment of meta-test tasks. The forwarded submission will be evaluated on 6000 any-way any-shot tasks carved out from 10 fresh datasets (600 tasks per dataset), i.e., not seen in either the Public phase or the Feedback phase. During this phase, all submissions will be run three times with various random seeds, and the worst normalized classification accuracy over all meta-test tasks will be used for the final ranking.

Competition Ends

Oct. 15, 2022, 11:59 p.m.

You must be logged in to participate in competitions.

Sign In