Guided Dropout

Understand

Dropout is often used in deep neural networks to prevent over-fitting.

• Conventionally, dropout training invokes \textit{random drop} of nodes from the hidden layers of a Neural Network.
• It is our hypothesis that a guided selection of nodes for intelligent dropout can lead to better generalization as compared to the traditional dropout.
• In this research, we propose "guided dropout" for training deep neural network which drop nodes by measuring the strength of each node.