Trojan Detection Challenge - Detection Track Forum

Go back to competition Back to thread list Post in this thread

> Max submission times for test phase

Dear organizers,

The website mentions that the max submission times for the test phase is 5 in total.
I am wondering it is the max submission times for a team or a participant (one member of a team)?

Best

Posted by: zhentingwang @ Oct. 16, 2022, 4 p.m.

Hello,

The CodaLab submission limits are per-participant, not per-team.

We recognize that this gives a slight advantage to large teams (e.g., >5 members), and unfortunately there is no easy way to change this. If we find evidence of teams recruiting additional members to abuse this function, this will be considered an instance of double registration (a violation of the rules).

All the best,
Mantas (TDC co-organizer)

Posted by: mmazeika @ Oct. 16, 2022, 4:53 p.m.

Hello,

We have decided to change our policy regarding this to more closely match our initial intentions of 5 submissions per team. Please disregard the previous post.

We will only allow 5 submissions per team in the test phase and the final round. This will be enforced by only keeping the first 5 submissions from members of a particular team. Concretely, if we see more than 5 submissions from an individual team on one of the test leaderboards, we will remove all submissions except the initial 5 submissions and select the top-performing submission among those 5 to obtain the leaderboard rank for that team.

All the best,
Mantas (TDC co-organizer)

Posted by: mmazeika @ Oct. 16, 2022, 6:35 p.m.
Post in this thread