Cross-Domain MetaDL

Organized by dustinc - Current server time: July 7, 2022, 5:01 a.m. UTC
Reward $4,000

Current

Feedback
July 1, 2022, midnight UTC

Next

Final
Sept. 1, 2022, midnight UTC

End

Competition Ends
Oct. 15, 2022, midnight UTC

Feedback

Start: July 1, 2022, midnight

Description: Participants can make 2 submissions per day and a maximum of 100 submissions during the whole phase. Each submission will be evaluated on 1000 any-way any-shot tasks carved out from 10 datasets (100 tasks per dataset) different than the ones used for meta-training (Public data). Additionally, each submission cannot take more than 5 hours of running time. During this phase, the normalized classification accuracy over all tasks, the normalized classification accuracy per dataset, and the total execution time will be displayed on the Competition Leaderboard.

Final

Start: Sept. 1, 2022, midnight

Description: The participants are not allowed to make submissions; instead, their last submission on the Feedback phase will be automatically forwarded to this phase, and the allowed running time will increase as needed (probably 10 hours maximum). The forwarded submission will be evaluated on 6000 any-way any-shot tasks carved out from 10 fresh datasets (600 tasks per dataset), i.e., not seen in either the Public phase or the Feedback phase. During this phase, all submissions will be run three times with various random seeds, and the worst normalized classification accuracy over all meta-test tasks will be used for the final ranking.

Competition Ends

Oct. 15, 2022, midnight

You must be logged in to participate in competitions.

Sign In
# Username Score
1 metadelta_baseline 0.59
2 EmmanuelPintelas 0.56
3 Oliver 0.53