Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs

Understand

Large language models (LLMs) have revolutionized the field of natural language processing (NLP), and recent studies have aimed to understand their underlying mechanisms.

• However, most of this research is conducted within a monolingual setting, primarily focusing on English.
• Few studies have attempted to explore the internal workings of LLMs in multilingual settings.
• In this study, we aim to fill this research gap by examining how neuron activation is shared across tasks and languages.