Convolutional Gated MLP: Combining Convolutions & gMLP

Understand

To the best of our knowledge, this is the first paper to introduce Convolutions to Gated MultiLayer Perceptron and contributes an implementation of this novel Deep Learning architecture.

• Google Brain introduced the gMLP in May 2021.
• Microsoft introduced Convolutions in Vision Transformer in Mar 2021.
• Inspired by both gMLP and CvT, we introduce convolutional layers in gMLP.