Evaluation

This subtrack is a decision prediction problem.

There are 2 phases:

• Phase 1: Dry-run phase. We provide you with 146 labeled dry-run data. Its label share the same format with the final testing labels. This set is provided just to validate your prediction format (so you can work with our final testing in the end). The performance of your LAST submission will be displayed on the leaderboard.
• Phase 2: Final testing phase. You can make predictions for the test dataset. Your last submission of phase 1 will be automatically forwarded. Your performance on the test set will appear on the leaderboard when the organizers finish checking the submissions.

Please rename your result file as "driving_pred.json" before you submit.

Please directly zip your results. DO NOT put them in a directory.

This competition only allows you to submit the prediction results (no code).

However, the winner and the two runner ups are required to submit their model codes. Challenge organizers will test the reproducibility. Failure of reproducing the performance will lead the result on the leaderboard marked as invalid.

The submissions are evaluated using the Accuracy metric.

Note that results might not be submitted successfully, just try to resubmit your results.

1st ITSS Student Competition in Pedestrian Behavior Prediction: Rules

Final submissions must be made before the end of phase 2. You may submit 10 submissions every day and 100 in total.

Please see the full rules here.