We are entering the final stretch of our competition and preparing for the private test stage! Note that this transition requires some adjustments, please read them carefully:
1. We no longer accept package requests. Hence, the docker environment for the next phase (private test) of the competition is set. Therefore, we recommend that you ensure your model runs in the current environment.
2. On June 21, 8 AM (UTC), the public test stage will end, and you will not be able to get a score on the public test set.
3. During the private test stage which will take place from June 21st to June 28th, you may submit up to 2 models, download them to your computer and upload them to the "Submit/View Results" page. Once you have done so, you will receive a feedback: "finished" or "failed". If you encounter any problems while submitting your model, please don't hesitate to contact us by email. We do not recommend submitting a failed model in stage 2.
4. Shortly after June 28 we will publish the private test stage leaderboard with the potential winners and begin to conduct a thorough validation of the leaders’ winning-eligibility. Once done, the validated leaders will officially become winners and the competition winners will be officially announced.
We hope you enjoy the competition and look forward to evaluating your submissions on the private stage!
Good luck,
MAFAT Challenge Team
can you please explain point 3 ? Can we submit new models in the private stage (although we know that we won't get their public score) ? Will we get feedback on if a submission is failed or not in stage 2 ? So in case a model is failed, will that be counted ? Since we only have 2 submissions. Request you to please elaborate on stage 2, as it's not very clear now
Posted by: devnikhilmishra @ June 20, 2022, 10:12 a.m.also would really appreciate if the answer to this question is given quickly, since the last day is tomorrow
Posted by: devnikhilmishra @ June 20, 2022, 10:36 a.m.Hi - the way I understand it, is that we can only resubmit a model we already submitted during the public stage. We can not submit any new models.
My question is - how do we select the model to submit? Do we get any additional info during the private stage that we do not have access to already?
TIA
skaak
thanks for the quick response, and congratulations on the great result currently. All the best
Posted by: devnikhilmishra @ June 20, 2022, 1:47 p.m.Thanks, its a pleasure, and congrats on your good result also.
Of course my reply is just my opinion, would be better if host responds ...
Posted by: skaak @ June 20, 2022, 2:36 p.m.Hi devnikhilmishra,
During the private stage, you may select up to 2 models already submitted at the public stage, download them to your computer, and upload them for final judging. You are not allowed to submit new models. You will get feedback if the submission is failed or finished. In case of failure, it won’t count in the total submissions.
MAFAT Challenge Team
Hi skaak,
It’s true, you must submit the models you submitted in the public phase. Participants will not receive more information about their submissions, so it’s up to you to choose the best models :)
MAFAT Challenge Team
Thanks MAFAT ... I think the perfect track 2 solution will be MAE = 0.42 but, as Fermat said, not enough space to implement it here.
Posted by: skaak @ June 21, 2022, 7:29 a.m.Hi skaak, which post are you referring to when you say, "As Fermat said, not enough space to implement it here ?". Also I am really curious, what makes you think the best possible score is 0.42 ?
Posted by: devnikhilmishra @ June 21, 2022, 8 a.m.Hi d, he he, this is somewhat tongue in cheek.
Both references are to pop culture, e.g. 42 is the solution to everything from Hitchhikers guide to the galaxy, and often used as random seed. Also, Fermat (the mathematician from long ago) wrote he will prove his famous and horribly difficult theorem in the margin if only there were more space there. I'm just playing with his words here ...
Anyhow, phew, what a scramble (for me - trust you had an easier time ...)
To MAFAT - all our results are gone now? How can we choose?
I suppose soon you will make our subs available to us again so we can see scores and select and also so we can download and resubmit?
TIA
skaak
oops sorry, I missed the infamous 42 reference, I had a really hard time to be honest, with not-so-great results.I am eager to know of know of the winners and their approaches. Hope you get the prize :D
Posted by: devnikhilmishra @ June 21, 2022, 8:51 a.m.Thanks d, don't be hard on yourself, I think you did very well. This was very hard and even funny comp. Initially I treated it like fluid mechanics but that helped nothing ...
MAFAT - oops, I now realize, there are now two places, public and private, with results and subs.
Posted by: skaak @ June 21, 2022, 9:53 a.m.MAFAT if I have problems with submissions how can I contact you by email?
tried to submit my best one and somehow it submitted something else
Hi NoamLhiyani,
You can email us at: team@mafatchallenge.com.
We will do our best to help :)