Dear Organizers,
We noticed that no specific validation file is provided to define the image order. Could you please confirm whether the image order in the uploaded files has any impact on the performance evaluation?
Best regards
Posted by: Caesar_D @ May 27, 2025, 2:25 p.m.Thanks for the question! The image order will not have an impact on the evaluation. However, the submission file must contain a header in the first row.
Example:
Image,MOS
000001.png,0.64246
000000.png,0.41235
Dear Organizers,
I encountered the following error:
"Traceback (most recent call last):
File "/tmp/codalab/tmptkZePz/run/program/evaluate.py", line 67, in
srcc, plcc = calc_metrics(submit_file, gt_file)
File "/tmp/codalab/tmptkZePz/run/program/evaluate.py", line 6, in calc_metrics
with open(submit_file, 'r') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/codalab/tmptkZePz/run/input/res/results.csv'"
However, I did include results.csv in the submitted archive. Could you please help check what might be causing this issue?
Posted by: Caesar_D @ May 27, 2025, 3:22 p.m.Can you make sure the files are directly in the root of the compressed archive, not in a folder?
Posted by: sizhuoma @ May 27, 2025, 5:15 p.m.Thanks for the reminder, that's exactly the issue.
Posted by: Caesar_D @ May 28, 2025, 4:11 a.m.That's great to hear! We updated the evaluation section to emphasize this.
Posted by: sizhuoma @ May 28, 2025, 8:21 p.m.