Training Sparse Neural Networks

Understand

Deep neural networks with lots of parameters are typically used for large-scale computer vision tasks such as image classification.

• This is a result of using dense matrix multiplications and convolutions.
• However, sparse computations are known to be much more efficient.
• In this work, we train and build neural networks which implicitly use sparse computations.