Local explainability prize - data selection clarification

PREPARE Challenge
1

Hello, I have a quick question about the Explainability Bonus Track.

The last line of the introduction for the bonus track states: “assume that the fictional patient in this case is preclinical (i.e., cognitively healthy)”.

Does this mean our explainers should only use members of the control group? The page later states to “make sure to choose three examples that demonstrate different types of model behaviors”.

I would appreciate any clarification on how we should select the 3 patients to explain. Ex: is there any requirements for them to belong to a certain class, or are we free to pick any 3 patients that best illustrate our model? Further, is there any requirement for the patients to be from the test or train sets?

Thanks!
Matt

2

Hello! Thanks for the questions!

There is guidance on the types of patients you should pick depending on your track here. Within the specified types, you may pick any patients that best illustrate your model’s explainability, from either the train or test set.

The last line of the introduction for the bonus track (“assume that the fictional patient in this case is preclinical (i.e., cognitively healthy)”) means that you should write your explainers for a cognitively healthy audience, regardless of each patient’s actual cognitive status. In other words, you don’t need to adapt your language or visualizations for cognitive disabilities. Write as if you are explaining predictions to a hypothetical preclinical version of any patients who have or are predicted to have cognitive decline.

1 Like