Frame number miss match in test set

N+1 Fish, N+2 Fish
1

Hi,
I have found a miss match in the test set frame numbers. According to ‘submission_format_zeros’ (sfz) we have 918503 frames in total. However, I only get 918329 frames.
The video id’s for which the frame numbers do not add up are:
[‘bc6hkwua3iLReunk’, ‘8jkQWJWPCtIvcnmH’, ‘tJinkrdMMZ477RGi’, ‘P3QkoeOjxoM6pDKb’, ‘pGd0FSJQcDH5DI8x’, ‘Sw0AgnH8BY1BDGHu’, ‘ZU6XtvFk0UMrHLEL’, ‘LU2DSX6VZcIsiyaW’]
and they are off by [1, 1, -3, 172, 1, 1, 1, 1] (‘sfz’ - ‘actual frames’).

Can someone confirm this please?

1 Like
2

I got the same frame mismatch too. I re-downloaded P3QkoeOjxoM6pDKb, with the missing 172 frame, from torrent, same result. Just padding with all zeros for now.

3

Hello,

Thanks for bringing this to our attention. I will look into this issue and get back to you on root causes.

Thanks,

-Ben

4

Hello,

I have looked into the mismatched frames and confirmed your findings. Our guidance is to zero pad at the end videos where there are extra frames in the submission format, and to remove predictions for the final 3 frames for the video that has -3. We will ensure that all relevant statistics regarding the presence/absence of species is accounted for.

Thanks,

-Ben