Fetching the paper…
Reading the bibliography…
We examine how recently documented, fundamental phenomena in deep learning models subject to pruning are affected by changes in the pruning procedure.
Etude de la distribution florale dans une portion des alpes et du jura
Paul Jaccard · 1901
Earlier work this paper cites.
The state of sparsity in deep neural networks
Trevor Gale, Erich Elsen, and Sara Hooker · 1902
Earlier work this paper cites.
Identity crisis: Memorization and generalization under extreme overparameterization
Chiyuan Zhang, Samy Bengio, Moritz Hardt, and Yoram Singer · 1902
Earlier work this paper cites.
The lottery ticket hypothesis at scale
Jonathan Frankle, Gintare Karolina Dziugaite, Daniel M Roy, and Michael Carbin · 1903
Earlier work this paper cites.
Deconstructing lottery tickets: Zeros, signs, and the supermask
Hattie Zhou, Janice Lan, Rosanne Liu, and Jason Yosinski · 1905
Earlier work this paper cites.
Classification and Regression Trees
L. Breiman, J. Friedman, C.J. Stone, and R.A. Olshen · 1984
Earlier work this paper cites.
Comparing biases for minimal network construction with back-propagation
Stephen José Hanson and Lorien Y Pratt · 1989
Earlier work this paper cites.
An empirical comparison of pruning methods for decision tree induction
John Mingers · 1989
Earlier work this paper cites.
Second order derivatives for network pruning: Optimal brain surgeon
Babak Hassibi and David G. Stork · 1993
Earlier work this paper cites.
Overfitting avoidance as bias
Cullen Schaffer · 1993
Earlier work this paper cites.
The MNIST database of handwritten digits. , 1994
Yann LeCun, Corinna Cortes, and Christopher J. C. Burges · 1994
Earlier work this paper cites.
Evolving neural networks through augmenting topologies
Kenneth O. Stanley and Risto Miikkulainen · 2002
Earlier work this paper cites.
Neuroevolution: from architectures to learning
Dario Floreano, Peter Dürr, and Claudio Mattiussi · 2008
Earlier work this paper cites.
Learning multiple layers of features from tiny images
A Krizhevsky · 2009
Earlier work this paper cites.
Measuring the usefulness of hidden units in boltzmann machines with mutual information
Mathias Berglund, Tapani Raiko, and KyungHyun Cho · 2013
Earlier work this paper cites.
Very deep convolutional networks for Large-Scale image recognition
Karen Simonyan and Andrew Zisserman · 2014
Cited alongside, same era.
Learning both weights and connections for efficient neural network
S Han, J Pool, J Tran, and W Dally · 2015
Cited alongside, same era.
Song Han, Huizi Mao, and William J. Dally · 2015
Cited alongside, same era.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2015
Cited alongside, same era.
ImageNet large scale visual recognition challenge
Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C Berg, and Li Fei-Fei · 2015
AI and compute
Dario Amodei and Danny Hernandez · 2018
Later among the works it cites.
Reconciling modern machine learning and the bias-variance trade-off
M. Belkin, D. Hsu, S. Ma, and S. Mandal · 2018
Later among the works it cites.
Kedar Dhamdhere, Mukund Sundararajan, and Qiqi Yan · 2018
Later among the works it cites.
On the Power of Over-parametrization in Neural Networks with Quadratic Activation
Simon S. Du and Jason D. Lee · 2018
Later among the works it cites.
Gradient Descent Provably Optimizes Over-parameterized Neural Networks
Simon S. Du, Xiyu Zhai, Barnabas Poczos, and Aarti Singh · 2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Dynamic Network Surgery for Efficient DNNs
Yiwen Guo, Anbang Yao, and Yurong Chen · 2016
Cited alongside, same era.
Designing Energy-Efficient Convolutional Neural Networks using Energy-Aware Pruning
Tien-Ju Yang, Yu-Hsin Chen, and Vivienne Sze · 2016
Cited alongside, same era.
ThiNet: A Filter Level Pruning Method for Deep Neural Network Compression
Jian-Hao Luo, Jianxin Wu, and Weiyao Lin · 2017
Cited alongside, same era.
Automatic differentiation in PyTorch
Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer · 2017
Cited alongside, same era.
Learning important features through propagating activation differences
Avanti Shrikumar, Peyton Greenside, and Anshul Kundaje · 2017
Cited alongside, same era.
Frederick Tung, Srikanth Muralidharan, and Greg Mori · 2017
Cited alongside, same era.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł Ukasz Kaiser, and Illia Polosukhin · 2017
Cited alongside, same era.
Jonathan Frankle and Michael Carbin · 2018
Later among the works it cites.
Rethinking the value of network pruning
Zhuang Liu, Mingjie Sun, Tinghui Zhou, Gao Huang, and Trevor Darrell · 2018
Later among the works it cites.
A systematic dnn weight pruning framework using alternating direction method of multipliers
Tianyun Zhang, Shaokai Ye, Kaiqi Zhang, Jian Tang, Wujie Wen, Makan Fardad, and Yanzhi Wang · 2018
Later among the works it cites.
Revisiting the importance of individual units in CNNs via ablation
Bolei Zhou, Yiyou Sun, David Bau, and Antonio Torralba · 2018
Later among the works it cites.
Redundant feature pruning for accelerated inference in deep neural networks
Babajide O. Ayinde, Tamer Inanc, and Jacek M. Zurada · 2019
Later among the works it cites.
Nest: A neural network synthesis tool based on a grow-and-prune paradigm
Xiaoliang Dai, Hongxu Yin, and Niraj Jha · 2019
Later among the works it cites.
Surprises in High-Dimensional Ridgeless Least Squares Interpolation
Trevor Hastie, Andrea Montanari, Saharon Rosset, and Ryan J. Tibshirani · 2019
Later among the works it cites.
Ari S. Morcos, Haonan Yu, Michela Paganini, and Yuand ong Tian · 2019
Later among the works it cites.
On Activation Function Coresets for Network Pruning
B. Mussay, S. Zhou, V. Braverman, and D. Feldman · 2019
Later among the works it cites.
Exploring Randomly Wired Neural Networks for Image Recognition
Saining Xie, Alexander Kirillov, Ross Girshick, and Kaiming He · 2019
Later among the works it cites.