Forums

Trojan Detection Challenge - Detection Track Forum

Go back to competition Back to thread list Post in this thread

> test sets

Hello,

We only have 1 week to submit for the test sets in the primary round - which is fine.

However, I would like to know when the test sets will be released ? Due to the computation limit, it would be nice to have the test sets one month before the final submissions.

Best
T

Posted by: tak @ Aug. 28, 2022, 9:27 a.m.

Hello,

We had originally planned to release the test sets for all tracks along with the opening of the test phase to encourage the development of detectors that run fairly quickly. However, due to your request we will try to release the test set one week beforehand. We are unable to release the test set earlier than one week beforehand, and we apologize if this causes any inconvenience. Note that if one has access to multiple machines or a compute cluster, then predictions can be parallelized. If one only has access to a single machine and is a student participant, we may be able to offer an AWS compute credit grant: https://trojandetection.ai/resources

All the best,
Mantas (TDC co-organizer)

Posted by: mmazeika @ Aug. 29, 2022, 11:13 p.m.

Thanks.
Please separate the dataset to make the download process easier!

Posted by: tak @ Sept. 3, 2022, 3:14 p.m.

Hello,

Sorry for the late reply. The datasets for individual tracks are now available at the following Zenodo links:
- Detection: https://zenodo.org/record/7059487
- Target Label Prediction: https://zenodo.org/record/7063081
- Trigger Synthesis: https://zenodo.org/record/7063103
- Evasive Trojans: https://zenodo.org/record/7063166

All the best,
Mantas (TDC co-organizer)

Posted by: mmazeika @ Sept. 8, 2022, 9:41 p.m.

Hi,

I am wondering when can we have access to the test set for each track?

Best

Posted by: easytrojansniper @ Oct. 10, 2022, 5:12 a.m.

Hello,

The test set for the Evasive Trojans track will be released tomorrow. I apologize for the delay. The other test sets will be released in the next few days.

All the best,
Mantas (TDC co-organizer)

Posted by: mmazeika @ Oct. 11, 2022, 7:19 p.m.

Hello,

The attack specifications for the test phase of the competition are available here: https://drive.google.com/file/d/1EX3ev8RM3H3hyN8CsTYfZ5GjEl4rIPpu/view?usp=sharing

They will also be available in the updated datasets on zenodo on 10/15 (this Saturday).

All the best,
Mantas (TDC co-organizer)

Posted by: mmazeika @ Oct. 13, 2022, 10:08 a.m.
Post in this thread