NTIRE 2025 Short-form UGC Video Quality Assessment and Enhancement Challenge-Track1-VQA Forum

Go back to competition Back to thread list Post in this thread

> Data Leaking on the validation set

Dear Organizing Committee,

We have noticed that this year’s competition dataset partially overlaps with last year’s validation set, which is still accessible through historical links. Given this, we have two questions:

Are participants allowed to use the validation set for training in this year’s KVQ competition?
During the evaluation phase, how can we effectively determine whether a participant’s submission has been trained on the validation set, leading to potential label leakage?
We appreciate your clarification. Thank you!

Posted by: cydiachen @ March 7, 2025, 1:24 a.m.

Thanks for your questions. Yes, you can utilize the validation for training in the test stage, I will release its label together.

Posted by: Xin.Li @ March 16, 2025, 1:35 p.m.
Post in this thread