Hello,
All my submissions failed with "Expected model in '/tmp/codalab/tmp00HPFK/run/input/res/id-0000/model.pt', but this path does not exist."
Can you give a right example zip to submit?
Thanks,
Hb
Hello,
The zip file of models that you submit for the validation phase should unzip into 200 folders with the names id-####, where #### indicates the model ID corresponding to the attack specification in evasive_trojans/val/attack_specifications.pkl (available here: https://zenodo.org/record/7063166#.Y0MvF3XMIqU). Each id-#### folder should have a model.pt file inside of it specifying an MNIST model.
There is some code towards the end of the starter kit that creates a zip file with the correct format: https://github.com/mmazeika/tdc-starter-kit/blob/main/evasive_trojans/example_submission.ipynb. As an example of a correct submission, here is the zip file for the standard trojans baseline: https://drive.google.com/file/d/1UUs6FioNnlytq-UORdWImsMpm9GBow9q/view?usp=sharing.
All the best,
Mantas (TDC co-organizer)
OK, Thank you for your kindly reply!
Posted by: Happybadminton @ Oct. 10, 2022, 1:43 a.m.