Overall Evaluation Criteria

Water Supply Forecast Rodeo
1

Since it is allowed to redevelop/improve/rethink a modelling approach at this stage, latest model and reports can contest for 90% of overall evaluation criteria. However rest 10%(Forecast Skill (Forecast) (10%)) will take into account evaluation from a model which has already been submitted into forecast stage .So there is no scope to improve upon this criterion. Is it correct?

If yes, is it possible to revisit and change criteria for that rest 10% somehow so that contestants can contest in this stage for 100% of evaluation criteria on the basis of only fresh/updated work?

Thank you!

2

Hi @kmande,

That is correct. The 10% Forecast Skill (Forecast) is based on the performance of your frozen model in the Forecast Stage. Your submissions to the Final Prize Stage do not affect the outcome for that portion of the evaluation. The work you submit to the Final Prize Stage will constitute 90% of the evaluation score.

This has been chosen to balance a variety of considerations and goals of the challenge. There are no plans to change the evaluation criteria for the Final Prize Stage.