The false hope of current approaches to explainable AI in healthcare

“You could have many explanations for what a complex model is doing. Do you just pick the one you “want” to be correct?”
Cynthia Rudin, Computer scientist

This commentary from Lancet Digital Health discusses the explainability issue of artificial intelligence in medicine with its myriad nuances. I do agree with the authors that the expectation that artificial intelligence tools can be explained, at least at the superficial level, is somewhat unrealistic and does in fact represent false hope. Perhaps we can also surmise that we may have just as difficult a time to put the thinking…