Roadmap of Designing Cognitive Metrics for Explainable Artificial Intelligence (XAI)

Understand

More recently, Explainable Artificial Intelligence (XAI) research has shifted to focus on a more pragmatic or naturalistic account of understanding, that is, whether the stakeholders understand the explanation.

• This point is especially important for research on evaluation methods for XAI systems.
• Thus, another direction where XAI research can benefit significantly from cognitive science and psychology research is ways to measure understanding of users, responses and attitudes.
• These measures can be used to quantify explanation quality and as feedback to the XAI system to improve the explanations.