Restricting the Flow: Information Bottlenecks for Attribution

Understand

Attribution methods provide insights into the decision-making of machine learning models like artificial neural networks.

• For a given input sample, they assign a relevance score to each individual input variable, such as the pixels of an image.
• In this work we adapt the information bottleneck concept for attribution.
• By adding noise to intermediate feature maps we restrict the flow of information and can quantify (in bits) how much information image regions provide.