Layer-adaptive sparsity for the Magnitude-based Pruning

Comparing biases for minimal network construction with back-propagation

S. J. Hanson and L. Y. Pratt · 1988

Earlier work this paper cites.

Skeletonization: A technique for trimming the fat from a network via relevance assessment

M. C. Mozer and P. Smolensky · 1988

Earlier work this paper cites.

Pruning versus clipping in neural networks

S. A. Janowsky · 1989

Earlier work this paper cites.

Optimal brain damage

Y. LeCun, J. S. Denker, and S. A. Solla · 1989

Earlier work this paper cites.

Second order derivatives for network pruning: Optimal brain surgeon

B. Hassibi and D. G. Stork · 1993

Earlier work this paper cites.

Building a larger annotated corpus of English: The Penn treebank

M. Marcus, B. Santorini, and M. Marcinkiewicz · 1993

Earlier work this paper cites.

Learning multiple layers of features from tiny images

A. Krizhevsky and G. Hinton · 2009

Earlier work this paper cites.

Reading digits in natural images with unsupervised feature learning

Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu, and A. Y. Ng · 2011

Earlier work this paper cites.

Learning both weights and connections for efficient neural network

S. Han, J. Pool, J. Tran, and W. Dally · 2015

Earlier work this paper cites.

Norm-based capacity control in neural networks

B. Neyshabur, R. Tomioka, and N. Srebro · 2015

Earlier work this paper cites.

Very deep convolutional networks for large-scale image recognition

K. Simonyan and A. Zisserman · 2015

Earlier work this paper cites.

Deep residual learning for image recognition

K. He, X. Zhang, S. Ren, and J. Sun · 2016

Earlier work this paper cites.

Pointer sentinel mixture models

S. Merity, C. Xiong, J. Bradbury, and R. Socher · 2016

Earlier work this paper cites.

Net-trim: Convex pruning of deep neural networks with performance guarantee

A. Aghasi, A. Abdi, N. Nguyen, and J. Romberg · 2017

Earlier work this paper cites.

Learning to prune deep neural networks via layer-wise optimal brain surgeon

X. Dong, S. Chen, and S. J. Pan · 2017

Earlier work this paper cites.

Densely connected convolutional networks

Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q Weinberger · 2017

Earlier work this paper cites.

Runtime neural pruning

J. Lin, Y. Rao, J. Lu, and J. Zhou · 2017

Earlier work this paper cites.

Bayesian compression for deep learning

C. Louizos, K. Ullrich, and M. Welling · 2017

Cited alongside, same era.

Variational dropout sparsifies deep neural networks

D. Molchanov, A. Ashukha, and D. Vetrov · 2017

Cited alongside, same era.

Attention is all you need

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin · 2017

Cited alongside, same era.

Compressing neural networks using the variational information bottleneck

B. Dai, C. Zhu, B. Guo, and D. Wipf · 2018

Cited alongside, same era.

AMC: AutoML for model compression and acceleration on mobile devices

Y. He, J. Lin, H. Wang, L.-J. Li, and S. Han · 2018

Cited alongside, same era.

Learning sparse neural networks through l 0 l_{0} regularization

C. Louizos, M. Welling, and D. P. Kingma · 2018

Cited alongside, same era.

Efficientnet: Rethinking model scaling for convolutional neural networks

M. Tan and Q. V. Le · 2019

Later among the works it cites.

Robustness may be at odds with accuracy

D. Tsipras, S. Santurkar, L. Engstrom, A. Turner, and A. Madry · 2019

Later among the works it cites.

AutoPrune: Automatic network pruning by regularizing auxiliary parameters

X. Xiao, Z. Wang, and S. Rajasekaran · 2019

Later among the works it cites.

Small ReLU networks are powerful memorizers: a tight analysis of memorization capacity

C. Yun, S. Sra, and A. Jadbabaie · 2019

Later among the works it cites.

Deconstructing lottery tickets: Zeros, signs, and supermasks

H. Zhou, J. Lan, R. Liu, and J. Yosinki · 2019

Later among the works it cites.

Fast sparse ConvNets

E. Elsen, M. Dukhan, T. Gale, and K. Simonyan · 2020

Closest in time.