UNCV2023 | MUAD Uncertainty Estimation for Semantic Segmentation Challenge @ICCV2023 Forum

Go back to competition Back to thread list Post in this thread

> Server Evaluation Time

Dear Organizers,
Could you please tell how much time it takes to evaluate a solution on the servers? As I have made a submission and it hasn't been evaluated for the past 2 hrs. Also, the competition ends today.

Regards,
Shyam

Posted by: Shyam671 @ Aug. 11, 2023, 12:24 p.m.

Dear Shyam,

From the backend, it seems like your latest submission is not uploaded (it shows your submission is 0 bytes).
Normally it tasks 3-5 minutes to evaluate, but actually I don't know the detail of the server because we used the one provided by codalab. So I'm not sure if it will take longer when there are more people submitting the results.

Best,
Xuanlong

Posted by: Xuanlong_Yu @ Aug. 11, 2023, 1:29 p.m.

Dear Shyam,

I just noticed this news. I will discuss this with the other organizers and inform you later.

Best,
Xuanlong

Posted by: Xuanlong_Yu @ Aug. 11, 2023, 1:55 p.m.

Dear Xuanlong,

Thank you for the reply.

Apparently, it is due to codalab facing some problems with the server.
https://github.com/codalab/codalab-competitions/issues/3413
Is it possible to extend the competition?

Regards,
Shyam Nandan

Posted by: Shyam671 @ Aug. 11, 2023, 1:55 p.m.

Dear Xuanlong,
Any update regarding the extension?
In case an extension is not possible, could you please increase the max number of submissions for today to at least 30 as half of the submissions got failed due to server error.

Regards,
Shyam

Posted by: Shyam671 @ Aug. 11, 2023, 5:20 p.m.

Dear Shyam,

We will extend it to Aug 14, 23:59 UTC. and we will send the e-mail to all the participants.

Best,
Xuanlong

Posted by: Xuanlong_Yu @ Aug. 11, 2023, 5:40 p.m.

Thank you!!

Posted by: Shyam671 @ Aug. 11, 2023, 5:44 p.m.
Post in this thread