LLM-assisted Concept Discovery: Automatically Identifying and Explaining Neuron Functions

Understand

Providing textual concept-based explanations for neurons in deep neural networks (DNNs) is of importance in understanding how a DNN model works.

• Prior works have associated concepts with neurons based on examples of concepts or a pre-defined set of concepts, thus limiting possible explanations to what the user expects, especially in discovering new concepts.
• Furthermore, defining the set of concepts requires manual work from the user, either by directly specifying them or collecting examples.
• To overcome these, we propose to leverage multimodal large language models for automatic and open-ended concept discovery.