MLP-Mixer: An all-MLP Architecture for Vision

Understand

Convolutional Neural Networks (CNNs) are the go-to model for computer vision.

• Recently, attention-based networks, such as the Vision Transformer, have also become popular.
• In this paper we show that while convolutions and attention are both sufficient for good performance, neither of them are necessary.
• We present MLP-Mixer, an architecture based exclusively on multi-layer perceptrons (MLPs).