Hi organizers,
Two questions about how submissions are scored, since they change the optimal way to build a submission:
-
The problem description says the test set consists of newly identified faults that are not in the USGS database, and the metric penalizes every predicted pixel of probability mass that is not within 300 m of a ground-truth pixel. If a submission predicts the known USGS/INGENIOUS fault traces (which we are asked to train on), do those predictions count as false positives, or are pixels near known faults masked out / excluded from the FP term when scoring against the new-fault labels?
-
For the Final Prize Round, is the “entire updated label set” the new-fault set (Initial Round labels + expert-verified additions), or does it also include the existing USGS/INGENIOUS faults?
Related: the description says predictions should cover “all faults in the region”. Should we read that as “predict the union of known and unknown faults”, or “predict the unknown ones”?
Thanks!