If we have code submissions that are still pending/running when the competition finishes, will these be executed and added to the leaderboard or will they be stopped?
On the same topic, I understand that the final ranking will be done on a yet undisclosed test dataset, different from the one used for the leaderboard ranking.
Which submission code will be used for that final ranking : the latest submission or the one that scored best on the leaderboard?
Hi @jearlyand @brice_tayart, thanks for these questions!
- Code submissions that have been submitted before the end of the competition are eligible and will be executed and added to the leaderboard, even if they have not completed execution by the submission deadline.
- The final ranking is based on the best score achieved on the private test set, not the latest submission.
Hope that helps!