MAFAT Satellite Vision Challenge Forum

Go back to competition Back to thread list Post in this thread

> Clarification request for "hermetically tagged" and metric code

A kind request to organizers to share the official metric implementation if possible.
It is unclear from evaluation description whether images, than marked as non-"hermetically tagged" are excluding predictions for small vehicles from the evaluation or not.
In other worst, if frame is not "hermetically tagged", if model predicts small vehicles they will be counted as FP if metric does not respect this flag.
Can you please clarify the logic of using" hermetic_small_vehicle" in the metric.

Posted by: BloodAxe @ March 6, 2023, 8:55 p.m.

If a frame is not "hermetically annotated", and the model predicts small vehicles, then the metric will not consider these predictions. Meaning it will not be counted as FP/TP/FN.
MAFAT Challenge Team

Posted by: MAFAT_Challenge @ March 7, 2023, 10:21 a.m.
Post in this thread