NTIRE 2025 Short-form UGC Video Quality Assessment and Enhancement Challenge-Track1-VQA Forum

Go back to competition Back to thread list Post in this thread

> Data Leaking on the validation set

Dear Organizing Committee,

We have noticed that this year’s competition dataset partially overlaps with last year’s validation set, which is still accessible through historical links. Given this, we have two questions:

Are participants allowed to use the validation set for training in this year’s KVQ competition?
During the evaluation phase, how can we effectively determine whether a participant’s submission has been trained on the validation set, leading to potential label leakage?
We appreciate your clarification. Thank you!

Posted by: cydiachen @ March 7, 2025, 1:24 a.m.
Post in this thread