As the deadline is approaching rapidly, we wanted to provide you with an update on how the final evaluation will take place. We will evaluate the final solutions (the ones submitted to the dev phase leaderboard and not necessarily the latest submission) using a different test seed to generate a test set of random problem instances. For the DAC4SGD track, these will be evaluated on 400 instances instead of the 80 instances used in the initial dev phase. As a result, we will also extend the evaluation time limit to 1.5x the time it takes to solve the same 400 instances using the baseline-ConstantLR scheduler.
IMPORTANT: Please submit your final solution to the dev phase leaderboard if you want it to be evaluated in the final phase. The deadline to make submissions is July 9 AOE (July 10, 11:59:59am UTC). Any submissions after this will not be taken into account for the final evaluation and the final leaderboard. Additionally, submissions that are identical to our baselines will not be considered eligible.
NOTE: If you submit a solution before the deadline but cannot manage to submit it to the leaderboard in time, please contact us by e-mail at adriaens@cs.uni-freiburg.de.
All the best for your submissions!
Posted by: adriaens @ July 6, 2022, 4:49 p.m.We have started the final evaluation of the submissions currently on the leaderboard and aim to have the final results by the end of this week. Thank you for participating!
Posted by: adriaens @ July 11, 2022, 7:01 a.m.