Back to DrivenData | Blog

Scoring Weights

I’m sorry if I missed this in the documentation, but I had a question about the scoring. In the weighted RMSLE, what are the values of the weights used? I’d like to calculate the score locally for validation but that part was unclear to me.

Great catch! Looks like we left those off the docs, so we’ll add them shortly. They are [1, 2, 5] for the levels [*, **, ***].

You can find an implementation (including the weights) in our metrics repo:

Good luck!

Peter