Hi,
Before you sent an email saying,“Track2 requires all methods to obtain at least 38.34 dB and 36.86dB PSNR and PSNR-mu scores respectively”,
I want to know whether this score is the score on the verification set or the test set?
According to the current leaderboard, this score may refer to the score on the verification set,
Is it possible to provide the at least score on the test set?
I have the same question.
And if the PSNR satisfies the requirements but muPSNR does not, is the solution accepted?
Thanks!
Dear xiaoliu and alexmahone,
The scores during the testing phase are hidden - participants will not know their score nor the baseline score (this is by design so - participants should not be able to tweak their solution on the test set, just on the validation set). Participants can compare against the baseline with the validation set and related scores, and ultimately they have to make sure that their solution performance does generalize to the testing set.
As for alexmahone question, solutions should outperform the baseline in both metrics PSNR and PSNR-mu.
Best regards,
Edu.