Fetching the paper…
Reading the bibliography…
Global Neuron Importance Estimation is used to prune neural networks for efficiency reasons.
Optimal brain damage
Yann LeCun, John Denker, and Sara Solla · 1989
Earlier work this paper cites.
Using relevance to reduce network size automatically
Michael C Mozer and Paul Smolensky · 1989
Earlier work this paper cites.
Optimal brain surgeon: Extensions and performance comparisons
Babak Hassibi, David Stork, and Gregory Wolff · 1993
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky, Geoffrey Hinton, et al · 2009
Earlier work this paper cites.
An analysis of single-layer networks in unsupervised feature learning
Adam Coates, Andrew Ng, and Honglak Lee · 2011
Earlier work this paper cites.
Distilling the knowledge in a neural network
Geoffrey Hinton, Oriol Vinyals, and Jeff Dean · 2015
Earlier work this paper cites.
Network trimming: A data-driven neuron pruning approach towards efficient deep architectures
Hengyuan Hu, Rui Peng, Yu-Wing Tai, and Chi-Keung Tang · 2016
Earlier work this paper cites.
Fast convnets using group-wise brain damage
Vadim Lebedev and Victor Lempitsky · 2016
Earlier work this paper cites.
Pruning convolutional neural networks for resource efficient inference
Pavlo Molchanov, Stephen Tyree, Tero Karras, Timo Aila, and Jan Kautz · 2016
Earlier work this paper cites.
Learning structured sparsity in deep neural networks
Wei Wen, Chunpeng Wu, Yandan Wang, Yiran Chen, and Hai Li · 2016
Earlier work this paper cites.
Morphnet: Fast & simple resource-constrained structure learning of deep networks
Ariel Gordon, Elad Eban, Ofir Nachum, Bo Chen, Hao Wu, Tien-Ju Yang, and Edward Choi · 2018
Cited alongside, same era.
Smallify: Learning network size while training
Guillaume Leclerc, Manasi Vartak, Raul Castro Fernandez, Tim Kraska, and Samuel Madden · 2018
Cited alongside, same era.
Snip: Single-shot network pruning based on connection sensitivity
Namhoon Lee, Thalaiyasingam Ajanthan, and Philip HS Torr · 2018
Cited alongside, same era.
Nisp: Pruning networks using neuron importance score propagation
Ruichi Yu, Ang Li, Chun-Fu Chen, Jui-Hsin Lai, Vlad I Morariu, Xintong Han, Mingfei Gao, Ching-Yung Lin, and Larry S Davis · 2018
Cited alongside, same era.
The state of sparsity in deep neural networks
Trevor Gale, Erich Elsen, and Sara Hooker · 2019
Woodfisher: Efficient second-order approximation for neural network compression
Sidak Pal Singh and Dan Alistarh · 2020
Later among the works it cites.
Picking winning tickets before training by preserving gradient flow
Chaoqi Wang, Guodong Zhang, and Roger Grosse · 2020
Later among the works it cites.
Regularize, expand and compress: Nonexpansive continual learning
Jie Zhang, Junting Zhang, Shalini Ghosh, Dawei Li, Jingwen Zhu, Heming Zhang, and Yalin Wang · 2020
Later among the works it cites.
Knowledge distillation: A survey
Jianping Gou, Baosheng Yu, Stephen J Maybank, and Dacheng Tao · 2021
Later among the works it cites.
Network pruning at scale: A discrete optimization approach
Wenyu Chen, Riade Benbaki, Xiang Meng, and Rahul Mazumder · 2022
Later among the works it cites.
Gradient flow in sparse neural networks and how lottery tickets win
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Importance estimation for neural network pruning
Pavlo Molchanov, Arun Mallya, Stephen Tyree, Iuri Frosio, and Jan Kautz · 2019
Cited alongside, same era.
What is the state of neural network pruning?
Davis Blalock, Jose Javier Gonzalez Ortiz, Jonathan Frankle, and John Guttag · 2020
Cited alongside, same era.
Incremental learning using a grow-and-prune paradigm with efficient neural networks
Xiaoliang Dai, Hongxu Yin, and Niraj K Jha · 2020
Cited alongside, same era.
A gradient flow framework for analyzing network pruning
Ekdeep Singh Lubana and Robert P Dick · 2020
Cited alongside, same era.
Song Han, Huizi Mao, and William J Dally
Cited in the paper.
Learning both weights and connections for efficient neural network
Song Han, Jeff Pool, John Tran, and William Dally
Cited in the paper.
Utku Evci, Yani Ioannou, Cem Keskin, and Yann Dauphin · 2022
Later among the works it cites.
Noisy heuristics nas: A network morphism based neural architecture search using heuristics
Suman Sapkota and Binod Bhattarai · 2022
Later among the works it cites.
The combinatorial brain surgeon: pruning weights that cancel one another in neural networks
Xin Yu, Thiago Serra, Srikumar Ramalingam, and Shandian Zhe · 2022
Later among the works it cites.
Shiwei Liu and Zhangyang Wang · 2023
Closest in time.