When a Relation Tells More Than a Concept: Exploring and Evaluating Classifier Decisions with CoReX

Understand

Explanations for Convolutional Neural Networks (CNNs) based on relevance of input pixels might be too unspecific to evaluate which and how input features impact model decisions.

• Especially in complex real-world domains like biology, the presence of specific concepts and of relations between concepts might be discriminating between classes.
• Pixel relevance is not expressive enough to convey this type of information.
• In consequence, model evaluation is limited and relevant aspects present in the data and influencing the model decisions might be overlooked.