Hi! Final phase submission page has max limits for 50 per day so I was under the impression that we could submit updated models during this phase. The github walkthrough says that evaluation is on June 25th and leaderboard has submission from the 20th. Are submissions closed at this point? Thanks!
Posted by: djcint @ June 22, 2022, 7:30 p.m.Yes, submissions are closed at this point.
Posted by: kevinduh @ June 22, 2022, 8:12 p.m.Thanks for the reply. Will set3 be released after the conference for enabling further research?
Posted by: djcint @ June 22, 2022, 8:17 p.m.That's a good question. Currently I'm thinking we'll keep set3 sequestered in case there's a need for a blind evaluation set in the future. But if you have a particular use case and set1/set2 aren't sufficient, I'd be happy to chat!
Posted by: kevinduh @ June 22, 2022, 8:19 p.m.Great, I'll reach out to you directly via email to continue the conversation.
Posted by: djcint @ June 22, 2022, 9:34 p.m.