How the jaccard index is aggregated across images?

NASA Pose Bowl
1

I believe there are two options to aggregate the jaccard index:

  1. Compute the jaccard index for each image and compute the average index for all the images.
  2. Compute an aggregated jaccard index using the area of all the images together

From my point of view, the first option has more sense, but I just want to check which option is used in the evaluation.

2

Yes, it’s the the average index (your #1). If you had this question it’s likely others do as well, so we will clarify on the problem description page.

1 Like