Fetching the paper…
Reading the bibliography…
The redundancy is widely recognized in Convolutional Neural Networks (CNNs), which enables to remove unimportant filters from convolutional layers so as to slim the network with acceptable performance drop.
Algorithm as 136: A k-means clustering algorithm
J. A. Hartigan and M. A. Wong · 1979
Earlier work this paper cites.
Handwritten digit recognition with a back-propagation network
Y. LeCun, B. E. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. E. Hubbard, and L. D. Jackel · 1990
Earlier work this paper cites.
Optimal brain damage
Y. LeCun, J. S. Denker, and S. A. Solla · 1990
Earlier work this paper cites.
A simple weight decay can improve generalization
A. Krogh and J. A. Hertz · 1992
Earlier work this paper cites.
Second order derivatives for network pruning: Optimal brain surgeon
B. Hassibi and D. G. Stork · 1993
Earlier work this paper cites.
Convolutional networks for images, speech, and time series
Y. LeCun, Y. Bengio, et al · 1995
Earlier work this paper cites.
An iterative pruning algorithm for feedforward neural networks
G. Castellano, A. M. Fanelli, and M. Pelillo · 1997
Earlier work this paper cites.
Face recognition: A convolutional neural-network approach
S. Lawrence, C. L. Giles, A. C. Tsoi, and A. D. Back · 1997
Earlier work this paper cites.
Pruning backpropagation neural networks using modern stochastic optimisation techniques
S. W. Stepniewski and A. J. Keane · 1997
Earlier work this paper cites.
A unified architecture for natural language processing: Deep neural networks with multitask learning
R. Collobert and J. Weston · 2008
Earlier work this paper cites.
The group-lasso for generalized linear models: uniqueness of solutions and efficient algorithms
V. Roth and B. Fischer · 2008
Earlier work this paper cites.
Imagenet: A large-scale hierarchical image database
J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei · 2009
Earlier work this paper cites.
Learning multiple layers of features from tiny images
A. Krizhevsky and G. Hinton · 2009
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
A. Krizhevsky, I. Sutskever, and G. E. Hinton · 2012
Earlier work this paper cites.
Predicting parameters in deep learning
M. Denil, B. Shakibi, L. Dinh, N. De Freitas, et al · 2013
Earlier work this paper cites.
Fast training of convolutional networks through ffts
M. Mathieu, M. Henaff, and Y. LeCun · 2013
Earlier work this paper cites.
Low-rank matrix factorization for deep neural network training with high-dimensional output targets
T. N. Sainath, B. Kingsbury, V. Sindhwani, E. Arisoy, and B. Ramabhadran · 2013
Earlier work this paper cites.
Restructuring of deep neural network acoustic models with singular value decomposition
J. Xue, J. Li, and Y. Gong · 2013
Earlier work this paper cites.
Do deep nets really need to be deep?
J. Ba and R. Caruana · 2014
Earlier work this paper cites.
Memory bounded deep convolutional networks
M. D. Collins and P. Kohli · 2014
Earlier work this paper cites.
Exploiting linear structure within convolutional networks for efficient evaluation
E. L. Denton, W. Zaremba, J. Bruna, Y. LeCun, and R. Fergus · 2014
Earlier work this paper cites.
Speeding up convolutional neural networks with low rank expansions
M. Jaderberg, A. Vedaldi, and A. Zisserman · 2014
Earlier work this paper cites.
Fitnets: Hints for thin deep nets
A. Romero, N. Ballas, S. E. Kahou, A. Chassang, C. Gatta, and Y. Bengio · 2014
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition
K. Simonyan and A. Zisserman · 2014
Earlier work this paper cites.
Fast convolutional nets with fbfft: A gpu performance evaluation
N. Vasilache, J. Johnson, M. Mathieu, S. Chintala, S. Piantino, and Y. LeCun · 2014
Cited alongside, same era.
An exploration of parameter redundancy in deep networks with circulant projections
Y. Cheng, F. X. Yu, R. S. Feris, S. Kumar, A. Choudhary, and S.-F. Chang · 2015
Cited alongside, same era.
Deep learning with limited numerical precision
S. Gupta, A. Agrawal, K. Gopalakrishnan, and P. Narayanan · 2015
Cited alongside, same era.
S. Han, H. Mao, and W. J. Dally · 2015
Cited alongside, same era.
Learning both weights and connections for efficient neural network
S. Han, J. Pool, J. Tran, and W. Dally · 2015
Cited alongside, same era.
Quantized convolutional neural networks for mobile devices
J. Wu, C. Leng, Y. Wang, Q. Hu, and J. Cheng · 2016
Later among the works it cites.
Accelerating very deep convolutional networks for classification and detection
X. Zhang, J. Zou, K. He, and J. Sun · 2016
Later among the works it cites.
Less is more: Towards compact cnns
H. Zhou, J. M. Alvarez, and F. Porikli · 2016
Later among the works it cites.
Structural compression of convolutional neural networks based on greedy filter pruning
R. Abbasi-Asl and B. Yu · 2017
Later among the works it cites.
Compression-aware training of deep networks
J. M. Alvarez and M. Salzmann · 2017
Later among the works it cites.
Structured pruning of deep convolutional neural networks
S. Anwar, K. Hwang, and W. Sung · 2017
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
G. Hinton, O. Vinyals, and J. Dean · 2015
Cited alongside, same era.
Batch normalization: Accelerating deep network training by reducing internal covariate shift
S. Ioffe and C. Szegedy · 2015
Cited alongside, same era.
Compression of deep convolutional neural networks for fast and low power mobile applications
Y.-D. Kim, E. Park, S. Yoo, T. Choi, L. Yang, and D. Shin · 2015
Cited alongside, same era.
Sparse convolutional neural networks
B. Liu, M. Wang, H. Foroosh, M. Tappen, and M. Pensky · 2015
Cited alongside, same era.
Channel-level acceleration of deep face representations
A. Polyak and L. Wolf · 2015
Cited alongside, same era.
Structured transforms for small-footprint deep learning
V. Sindhwani, T. Sainath, and S. Kumar · 2015
Cited alongside, same era.
Tensorflow: Large-scale machine learning on heterogeneous distributed systems
M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, et al · 2016
Cited alongside, same era.
Later among the works it cites.
Channel pruning for accelerating very deep neural networks
Y. He, X. Zhang, and J. Sun · 2017
Later among the works it cites.
Densely connected convolutional networks
G. Huang, Z. Liu, K. Q. Weinberger, and L. van der Maaten · 2017
Later among the works it cites.
Learning efficient convolutional networks through network slimming
Z. Liu, J. Li, Z. Shen, G. Huang, S. Yan, and C. Zhang · 2017
Later among the works it cites.
Thinet: A filter level pruning method for deep neural network compression
J.-H. Luo, J. Wu, and W. Lin · 2017
Later among the works it cites.
Beyond filters: Compact feature map for portable deep model
Y. Wang, C. Xu, C. Xu, and D. Tao · 2017
Later among the works it cites.
Auto-balanced filter pruning for efficient convolutional neural networks
X. Ding, G. Ding, J. Han, and S. Tang · 2018
Later among the works it cites.
Adc: Automated deep compression and acceleration with reinforcement learning
Y. He and S. Han · 2018
Later among the works it cites.
Soft filter pruning for accelerating deep convolutional neural networks
Y. He, G. Kang, X. Dong, Y. Fu, and Y. Yang · 2018
Later among the works it cites.
Accelerating convolutional networks via global & dynamic filter pruning
S. Lin, R. Ji, Y. Li, Y. Wu, F. Huang, and B. Zhang · 2018
Later among the works it cites.
Rethinking the value of network pruning
Z. Liu, M. Sun, T. Zhou, G. Huang, and T. Darrell · 2018
Later among the works it cites.
Autopruner: An end-to-end trainable filter pruning method for efficient deep model inference
J.-H. Luo and J. Wu · 2018
Later among the works it cites.
Leveraging filter correlations for deep model compression
P. Singh, V. K. Verma, P. Rai, and V. P. Namboodiri · 2018
Later among the works it cites.
Structured pruning for efficient convnets via incremental regularization
H. Wang, Q. Zhang, Y. Wang, and H. Hu · 2018
Later among the works it cites.
Nisp: Pruning networks using neuron importance score propagation
R. Yu, A. Li, C.-F. Chen, J.-H. Lai, V. I. Morariu, X. Han, M. Gao, C.-Y. Lin, and L. S. Davis · 2018
Later among the works it cites.
A systematic dnn weight pruning framework using alternating direction method of multipliers
T. Zhang, S. Ye, K. Zhang, J. Tang, W. Wen, M. Fardad, and Y. Wang · 2018
Later among the works it cites.
Discrimination-aware channel pruning for deep neural networks
Z. Zhuang, M. Tan, B. Zhuang, J. Liu, Y. Guo, Q. Wu, J. Huang, and J. Zhu · 2018
Later among the works it cites.
Towards compact convnets via structure-sparsity regularized filter pruning
S. Lin, R. Ji, Y. Li, C. Deng, and X. Li · 2019
Closest in time.