If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniques

Understand

In recent years, there has been an explosion of AI research on counterfactual explanations as a solution to the problem of eXplainable AI (XAI).

• These explanations seem to offer technical, psychological and legal benefits over other explanation techniques.
• We survey 100 distinct counterfactual explanation methods reported in the literature.
• This survey addresses the extent to which these methods have been adequately evaluated, both psychologically and computationally, and quantifies the shortfalls occurring.