Hi,
Thanks for great challenge.
Do you count the number of failed submissions?
Thank you,
Posted by: mmyy2513 @ Feb. 23, 2022, 8:50 a.m.the failed submissions do not count towards the maximum number of submissions
Posted by: Radu.Timofte @ Feb. 23, 2022, 11:19 a.m.Hello,
As far as I can see in the codalab system, failed submissions do count in the final count. This is not something we can modify. In the worst case, if the total number of submissions is reached (20), and you or another team has several failed submissions, we can increase the number of total submissions. That is not a problem.