SPARK 2022 - Stream 2 - Spacecraft Trajectory Estimation Forum

Go back to competition Back to thread list Post in this thread

> test submit error

WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
Traceback (most recent call last):
File "/tmp/codalab/tmpmjqyGl/run/program/evaluate.py", line 97, in
l_mean, or_mean, esa_mean = compute_score(truth_file, submission_file)
File "/tmp/codalab/tmpmjqyGl/run/program/evaluate.py", line 47, in compute_score
est_r = [image_data_est['Tx'].tolist()[0],image_data_est['Ty'].tolist()[0],image_data_est['Tz'].tolist()[0]]
IndexError: list index out of range

Posted by: heboyong @ July 3, 2022, 4:03 p.m.

We will check the submission and get back to you.

Posted by: spark @ July 3, 2022, 9:16 p.m.

How about this error?

Posted by: heboyong @ July 5, 2022, 1:22 p.m.

Can you try to submit it now? We managed to fix some issues in the code. Hopefully, it should work.

Posted by: spark @ July 6, 2022, 9:20 a.m.

Thank you. There still a problem, maybe caused by gt file?

WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
Traceback (most recent call last):
File "/tmp/codalab/tmpwPOF1E/run/program/evaluate.py", line 97, in
l_mean, or_mean, esa_mean = compute_score(truth_file, submission_file)
File "/tmp/codalab/tmpwPOF1E/run/program/evaluate.py", line 25, in compute_score
if len(df_gt) == len(df_est):
UnboundLocalError: local variable 'df_gt' referenced before assignment

Posted by: heboyong @ July 6, 2022, 9:59 a.m.

Thanks for your feedback and Sorry for the inconvenience.
Can you try one more time, please?
If you exceed the maximum submission for today, please let us know if we change that for today to check if it is okay.

Posted by: spark @ July 6, 2022, 3 p.m.

I got my test score in "Download output from scoring step", but there still shows failed and score is not shown in the result.
I think there is only the last step away from success.

Posted by: heboyong @ July 6, 2022, 3:26 p.m.

Seems everything is okay. We increased the number of submissions for today. Please try upload one more time please.
Thanks in advance.

Posted by: spark @ July 6, 2022, 3:28 p.m.

Great! I got right results, and thanks for you efforts.

Posted by: heboyong @ July 6, 2022, 3:36 p.m.

Thanks for your patience and feedback.

Posted by: spark @ July 6, 2022, 3:39 p.m.

And I have another question that I find the scores are:

translation_error:0.113250906293
orientation_error:0.54876090876
pose_error:0.569201827867

The pose error means the add of the location error and the orientation error?
I just want to make sure that there no more errors.

Posted by: heboyong @ July 6, 2022, 3:40 p.m.

Now the results are okay. Thanks for bringing it our attention.

Posted by: spark @ July 6, 2022, 4 p.m.

The ranking on the leaderboard seems to be wrong. Can you check it?

Posted by: heboyong @ July 8, 2022, 7:28 p.m.
Post in this thread