Is test data Hermeticly labelled ?
The test sets are annotated similarly to the training set.
If a frame is not "hermetically annotated", and the model predicts small vehicles, then the metric will not consider these predictions. Meaning it will not be counted as FP/TP/FN.
MAFAT Challenge Team