Fetching the paper…

Reading the bibliography…

2015

Fast Algorithms for Convolutional Neural Networks

Lavin, Andrew, Gray, Scott

Original
PDF
Post on X

Understand

Deep convolutional neural networks take GPU days of compute time to train on large data sets.

Pedestrian detection for self driving cars requires very low latency.
Image recognition for mobile phones is constrained by limited processing resources.
The success of convolutional neural networks in these situations is limited by how fast we can compute them.

Fast Algorithms for Convolutional Neural Networks · Around

Built on

Arithmetic complexity of computations
Shmuel Winograd · 1980
Earlier work this paper cites.
On multiplication of polynomials modulo a polynomial
Shmuel Winograd · 1980
Earlier work this paper cites.
Fast algorithms for signal processing
Richard E Blahut · 2010
Earlier work this paper cites.
The Digital Signal Processing Handbook
V. Madisetti · 2010
Earlier work this paper cites.
Fast training of convolutional networks through ffts
Original
Michaël Mathieu, Mikael Henaff, and Yann LeCun · 2013
Earlier work this paper cites.

Similar

Minimizing computation in convolutional neural networks
Jason Cong and Bingjun Xiao · 2014
Cited alongside, same era.
Low precision arithmetic for deep learning
Original
Matthieu Courbariaux, Yoshua Bengio, and Jean-Pierre David · 2014
Cited alongside, same era.
One weird trick for parallelizing convolutional neural networks
Original
Alex Krizhevsky · 2014
Cited alongside, same era.
Very deep convolutional networks for large-scale image recognition
Original
Karen Simonyan and Andrew Zisserman · 2014
Cited alongside, same era.
Fast convolutional nets with fbfft: A GPU performance evaluation
Original
Nicolas Vasilache, Jeff Johnson, Michaël Mathieu, Soumith Chintala, Serkan Piantino, and Yann LeCun · 2014
Cited alongside, same era.

Then

https://developer.nvidia.com/cudnn
cuDNN · 2015
Closest in time.
Deep learning with limited numerical precision
Original
Suyog Gupta, Ankur Agrawal, Kailash Gopalakrishnan, and Pritish Narayanan · 2015
Closest in time.
Model accuracy and runtime tradeoff in distributed deep learning
Original
Suyog Gupta, Wei Zhang, and Josh Milthrope · 2015
Closest in time.
Batch normalization: Accelerating deep network training by reducing internal covariate shift
Original
Sergey Ioffe and Christian Szegedy · 2015
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…