Dear,
From the email, there is: "Note that failed submissions (those marked as “Failed” in the status column) do not count towards this limit."
Does this mean that submissions with at least one invalid ID are counted as “failed”?
Best regards.
Posted by: szwsjc @ Sept. 24, 2024, 9:45 a.m.In addition, there is another requiremnet: "Please note that in the final phase, all valid submissions must include a Documentation file."
Do you mean the text documentation described in "controller description instructions.pdf"?
Posted by: szwsjc @ Sept. 24, 2024, 9:58 a.m.Hi,
A failed submission is one that failed to run on Codalab and you get an error instead of a score. In this case, you should not get anything returned other than the error message. If you go to "submit/ view results " on Codalab, it will say "failed" under in the status column (next to size)
Yes, the documentation file refers to a written description of your controller's approach, following the "controller description instructions" in the starting kit.
Posted by: bat @ Sept. 24, 2024, 10:18 a.m.So invalid ID-s don't make the submission failed.
Posted by: bat @ Sept. 24, 2024, 10:23 a.m.We have one more question in the submission step.
Three of us are from the same lab. However, we used different algorithms and coded them separately with different results. In fact, we used three different accounts and uploaded different valid scores during the training phase. So, can we submit the final results separately?
Posted by: szwsjc @ Sept. 24, 2024, 1:35 p.m.