HDR Video Quality Measurement Grand Challenge Forum

Go back to competition Back to thread list Post in this thread

> Challenge Registration Opens on 09/30/22

Challenge Registration Opens on 09/30/22!

Posted by: ericalingyuan @ Oct. 3, 2022, 2:20 a.m.

I am getting following error message while submitting the predictions.zip
WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
Traceback (most recent call last):
File "/tmp/codalab/tmpLl29Uf/run/program/evaluate.py", line 40, in
pred_FR = pd.read_csv(submission_answer_file_FR)
File "/opt/conda/lib/python3.9/site-packages/pandas/util/_decorators.py", line 311, in wrapper
return func(*args, **kwargs)
File "/opt/conda/lib/python3.9/site-packages/pandas/io/parsers/readers.py", line 680, in read_csv
return _read(filepath_or_buffer, kwds)
File "/opt/conda/lib/python3.9/site-packages/pandas/io/parsers/readers.py", line 575, in _read
parser = TextFileReader(filepath_or_buffer, **kwds)
File "/opt/conda/lib/python3.9/site-packages/pandas/io/parsers/readers.py", line 933, in __init__
self._engine = self._make_engine(f, self.engine)
File "/opt/conda/lib/python3.9/site-packages/pandas/io/parsers/readers.py", line 1217, in _make_engine
self.handles = get_handle( # type: ignore[call-overload]
File "/opt/conda/lib/python3.9/site-packages/pandas/io/common.py", line 789, in get_handle
handle = open(
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/codalab/tmpLl29Uf/run/input/res/predictions_FR.csv'

------------
My predictions.zip file contains these two files predictions_FR.csv and predictions_NR.csv

It would be really helpful if organizers or any other participant can suggest the solution for this error message and failure in submission.
Thank you.

Posted by: Aarna @ Oct. 29, 2022, 7:29 a.m.

Hi,
Did you put the two files into a folder before you zip it?
Please try to directly zip the two files into .zip without putting them into a folder first.
Thanks,
Let us know if it works.

Posted by: ericalingyuan @ Oct. 29, 2022, 7:49 a.m.

Thank you.
Directly zipping both the files without keeping inside a folder worked for "FileNotFoundException"
But now I am getting following KeyError:
-------
WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
Traceback (most recent call last):
File "/opt/conda/lib/python3.9/site-packages/pandas/core/indexes/base.py", line 3621, in get_loc
return self._engine.get_loc(casted_key)
File "pandas/_libs/index.pyx", line 136, in pandas._libs.index.IndexEngine.get_loc
File "pandas/_libs/index.pyx", line 163, in pandas._libs.index.IndexEngine.get_loc
File "pandas/_libs/hashtable_class_helper.pxi", line 5198, in pandas._libs.hashtable.PyObjectHashTable.get_item
File "pandas/_libs/hashtable_class_helper.pxi", line 5206, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'sureal_bright_mos_true'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/tmp/codalab/tmpEu_qUt/run/program/evaluate.py", line 43, in
result_RMSE_FR = math.sqrt(mean_squared_error(merged_FR['sureal_bright_mos_true'].values,merged_FR['sureal_bright_mos_pred'].values))
File "/opt/conda/lib/python3.9/site-packages/pandas/core/frame.py", line 3505, in __getitem__
indexer = self.columns.get_loc(key)
File "/opt/conda/lib/python3.9/site-packages/pandas/core/indexes/base.py", line 3623, in get_loc
raise KeyError(key) from err
KeyError: 'sureal_bright_mos_true'
----
There are only 2 columns in my CSVs "video" and "score" as mentioned on the WACV website.
Here are the first few line from one of the predictions.csv
-----
video,score
1080p_1M_Bonfire,48.045555
1080p_1M_CargoBoat,48.0455
1080p_1M_football1,48.045547

Posted by: Aarna @ Oct. 29, 2022, 8:08 a.m.

P.S. I also tried keeping "sureal_bright_mos_true" and "sureal_bright_mos_pred" instead of score in CSV file header. But that also doesn't work.

Posted by: Aarna @ Oct. 29, 2022, 8:10 a.m.

Hi,
The correct two column names should be "video,sureal_bright_mos". Sorry for the confusion, we will make the changes in the instructions!
Best regards,

Posted by: ericalingyuan @ Oct. 29, 2022, 8:18 a.m.

When will the team registration portal open ?
Thank you

Posted by: Aarna @ Nov. 8, 2022, 10:31 a.m.
Post in this thread