Access to runtime code output and artifacts from evaluation stage

Water Supply Forecast Rodeo
1

Hi @jayqi, is it possible to get the runtime code submission output and artifacts?

This includes:

  1. Output of prediction csv
  2. Input data used for model (in preprocessed dir)

The goal is to validate/debug local vs runtime submission run

2

Hi @rasyidstat,

We do not have a way for you to download the predictions CSV or the contents of preprocessed_dir.

One suggestion is to use logging to get information that you need. (Note that there is a limit on the length of the logs.) We are less restrictive in this competition about what you are allowed to log than others since the test data is not as sensitive/securely withheld as other typical competitions. Let me know if you have any further questions.

1 Like