Hi, after submitting the results for the final test, we can not get the scores from the system at this phase?
Posted by: hail_hydra @ July 18, 2022, 7:10 a.m.Hi,
At the testing phase, a valid submission entry should include results, code, and factsheet. The results submitted to Codalab server and rankings are not finalized, so we hide the leaderboard and participants cannot see the results. We will release the preliminary scores and ranking by the end of July. Good luck!
Best,
Organizers
Thanks for the reply. Do we need to submit the training code as well? Or just testing code?
Posted by: hail_hydra @ July 18, 2022, 7:45 a.m.Only executable testing code and a pre-trained model are required to reproduce the results. Thanks!
Posted by: jnjaby @ July 18, 2022, 8:38 a.m.Sorry to bother again. For the run-time, does it includes the data reading&writing time (time for io), or just the time of network processing?
Posted by: hail_hydra @ July 18, 2022, 9:37 a.m.IO time is not counted in Runtime.
Posted by: jnjaby @ July 18, 2022, 12:05 p.m.