Noether: The More Things Change, the More Stay the Same

Understand

Symmetries have proven to be important ingredients in the analysis of neural networks.

• So far their use has mostly been implicit or seemingly coincidental.
• We undertake a systematic study of the role that symmetry plays.
• In particular, we clarify how symmetry interacts with the learning algorithm.