MSD: Multi-Self-Distillation Learning via Multi-classifiers within Deep Neural Networks

Understand

As the development of neural networks, more and more deep neural networks are adopted in various tasks, such as image classification.

• However, as the huge computational overhead, these networks could not be applied on mobile devices or other low latency scenes.
• To address this dilemma, multi-classifier convolutional network is proposed to allow faster inference via early classifiers with the corresponding classifiers.
• These networks utilize sophisticated designing to increase the early classifier accuracy.