Meta-Learning to Compositionally Generalize

Understand

Natural language is compositional; the meaning of a sentence is a function of the meaning of its parts.

• This property allows humans to create and interpret novel sentences, generalizing robustly outside their prior experience.
• Neural networks have been shown to struggle with this kind of generalization, in particular performing poorly on tasks designed to assess compositional generalization (i.e.
• where training and testing distributions differ in ways that would be trivial for a compositional strategy to resolve).