Neural Network Topologies for Sparse Training

Y. LeCun, J. S. Denker, and S. A. Solla, “Optimal brain damage,” in Advances in neural information processing systems

1990

Earlier work this paper cites.

B. Hassibi and D. G. Stork, “Second order derivatives for network pruning: Optimal brain surgeon,” in Advances in neural information processing systems

1993

Earlier work this paper cites.

Numerical Analysis 2000. Vol. III: Linear Algebra

C. F. Loan, “The ubiquitous kronecker product,” Journal of Computational and Applied Mathematics · 2000

Earlier work this paper cites.

SIAM, 2011

J. Kepner and J. Gilbert, Graph Algorithms in the Language of Linear Algebra · 2011

Earlier work this paper cites.

now, 2012

S. P. Vadhan, Pseudorandomness · 2012

Earlier work this paper cites.

N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, “Dropout: a simple way to prevent neural networks from overfitting,” The Journal of Machine Learning Research

2014

Earlier work this paper cites.

C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,” in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

2015

Cited alongside, same era.

S. Srinivas and R. V. Babu, “Data-free parameter pruning for deep neural networks,” CoRR

Original

2015

Cited alongside, same era.

S. Han, H. Mao, and W. J. Dally, “Deep compression: Compressing deep neural network with pruning, trained quantization and huffman coding,” CoRR

Original

2015

Cited alongside, same era.

B. Liu, M. Wang, H. Foroosh, M. Tappen, and M. Penksy, “Sparse convolutional neural networks,” in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

2015

Cited alongside, same era.

F. N. Iandola, S. Han, M. W. Moskewicz, K. Ashraf, W. J. Dally, and K. Keutzer, “Squeezenet: Alexnet-level accuracy with 50x fewer parameters and¡ 0.5 mb model size,” arXiv preprint arXiv:1602.07360

A. Prabhu, G. Varma, and A. M. Namboodiri, “Deep expander networks: Efficient deep networks from graph theory,” CoRR

Original

2017

Later among the works it cites.

J. Kepner, V. Gadepally, H. Jananthan, L. Milechin, and S. Samsi, “Sparse deep neural network exact solutions,” in High Performance Extreme Computing Conference (HPEC)

2018

Closest in time.

M. Kumar, W. Horn, J. Kepner, J. Moreira, and P. Pattnaik, “Ibm power9 and cognitive computing,” IBM Journal of Research and Development

2018

Closest in time.

MIT Press, 2018

J. Kepner and H. Jananthan, Mathematics of Big Data: Spreadsheets, Databases, Matrices, and Graphs · 2018

Closest in time.

S. Alford and J. Kepner, “Training sparse neural networks,” in MIT Undergraduate Research Technology Conference

2018

Closest in time.