When the final leaderboard for the forecast stage will be available?

Hello @jayqi
Do you have any updates about scoring for the Forecast stage? When will we have a chance to get the final results?
Thanks!

Hi @RomanChernenko,

We are currently waiting for next week Wednesday, August 14 to get the ground truth data, per the problem description page:

All predictions will be scored against the latest water supply ground truth that is available as of August 14, 2024. This score will be used to determine prizes based on quantitative performance.

I’ll make an announcement with an update sometime in the week of August 19.

2 Likes

Hi @jayqi,
Are there any updates on when the Forecast stage leaderboard will be published?
In addition, when should we expect the scoring and announcement for the Final Prize stage (overall, bonus and explainability)?
Thanks

1 Like

Hi @rasyidstat, @RomanChernenko,

I’m excited to share that the leaderboard page for the Forecast Stage has been updated with the finalized results! Please also see this related announcement.

We are still in the judging process for the Final Stage. We don’t expect to have any results to announce for a few more weeks. Thanks for your patience.

2 Likes

Hi @jayqi, thanks for the update!
Just out of curiosity, is it possible to share the full ground truth data and also other participants’ 10th and 90th forecast?

1 Like

Hi @rasyidstat ,

You can find our forecasting logs at WSFR Forecasting Logs.

Cheers,
@mmiron

@jayqi : Could you kindly share an insights about the winners’ solutions ?

Hi @motoki,

We’re currently still finalizing the verification and reproduction of finalists solutions. There will be more news about this in the coming few weeks. Thanks for your patience.

1 Like