NTIRE 2022 Stereo Image Super-Resolution Challenge Forum

Go back to competition Back to thread list Post in this thread

> The reason for realizing Validation set?

Dear Challenge Organizers!

Thank you for organizing such an amazing challenge. I`m curious what was the reason for giving an access to the validation HR images. It discourages many participants to submit their solutions and hence no meaning of having Leaderboard.
I am fully aware that we will have a test images without HR images in the final stage, but still with LB, I would have some feedback whether my method works better/worse than other participant`s method.

Sincerely,
IPG

Posted by: ipg_mrc @ Feb. 3, 2022, 1:17 p.m.

Hi IPG,

We release HR images in the validation set for two reasons:
1) A validation set in a public dataset (i.e., Flickr1024) is used in this challenge, so we directly release the validation set as several previous challengese do.
2) The validation server is released a bit late, so we release the validation set for the convenience of participants to evaluate their models before the server is online.

To encourage participants to submit their results to the validation server, we do not realse codes for evaluation. It seems quite a few participants have submitted results to the server in the leaderboard.

Best Regards,
Longguang

Posted by: Rogen @ Feb. 7, 2022, 3:34 a.m.
Post in this thread