NTIRE 2022 High Dynamic Range Challenge - Track 2 Low-complexity (fidelity constrain) Forum

Go back to competition Back to thread list Post in this thread

> About the at least scores?

Hi,

Before you sent an email saying,“Track2 requires all methods to obtain at least 38.34 dB and 36.86dB PSNR and PSNR-mu scores respectively”,
I want to know whether this score is the score on the verification set or the test set?
According to the current leaderboard, this score may refer to the score on the verification set,
Is it possible to provide the at least score on the test set?

Posted by: xiaoliu @ March 23, 2022, 2:45 a.m.

I have the same question.

And if the PSNR satisfies the requirements but muPSNR does not, is the solution accepted?
Thanks!

Posted by: alexmahone @ March 23, 2022, 8:24 a.m.

Dear xiaoliu and alexmahone,

The scores during the testing phase are hidden - participants will not know their score nor the baseline score (this is by design so - participants should not be able to tweak their solution on the test set, just on the validation set). Participants can compare against the baseline with the validation set and related scores, and ultimately they have to make sure that their solution performance does generalize to the testing set.

As for alexmahone question, solutions should outperform the baseline in both metrics PSNR and PSNR-mu.

Best regards,
Edu.

Posted by: EPerezPellitero @ March 25, 2022, 6:06 p.m.
Post in this thread