Forums

> Codalab RMSE Metric Ranking

Dear organizers,

it seems like codalab assumes higher RMSE is better, which not only affects the leaderboard but also which of the own submissions is automatically submitted to the leaderboard.
Am I mistaken about whether lower RMSE should be better, or can this setting be changed in codalab?

Thank you in advance!

Kind regards,
Leander Girrbach

Posted by: LGirrbach @ June 2, 2022, 12:16 p.m.

---

Dear Leander,

thank you for pointing out the issue. We are working on it.

Best regards,
Salar

Posted by: qu.lab @ June 7, 2022, 7:48 a.m.

---

Hello,

could your provide the formula used to calculate the"RMSE_MAPPED" metric?

Jan

Posted by: jakel101 @ June 7, 2022, 12:17 p.m.