Hi, I don’t quite understand this remark in the description of how score for “Task 2: Identify species of fish” is calculated. The remark is
Note: For situations where AUC is undefined, MAE is calculated instead (e.g., for a video where all fish are the same species).
Why I find it confusing - I thought that AUC (I presume it’s ROC AUC) is calculated for each class on all frames across all videos. But this remark (“a video”) makes it sound like AUC is calculated on one video (or MAE if AUC is undefined) - is that correct? Are AUCs/MAEs on videos then averaged?