Hi organizers,
It seems everyone who manages to get a positive score on a testcase/scenario combination is able to calculate the baseline controller's score for that combination by summing:
1. The score of their controller calculated from the KPIs of their test on that combination using the score formula in the evaluation criteria.
2. Their submission score on that combination found in the "scores.txt" file in the "output from scoring step" archive of the submission.
Are my thoughts above correct? If so, could you please share the baseline controller's scores for all 4 testcase/scenario combinations publicly, rather than only with those who have positive scores?
Posted by: jmerle @ Aug. 11, 2024, 11:23 p.m.You can just run the cases without any controller input to get the KPI scores for the baseline
Posted by: haraldwalnum @ Aug. 12, 2024, 8:22 a.m.That's very helpful, thank you!
Posted by: jmerle @ Aug. 13, 2024, 4:09 p.m.