Enhancing the Regularization Effect of Weight Pruning in Artificial Neural Networks

“Optimal brain damage,”

Yann LeCun, John S Denker, and Sara A Solla, · 1990

Earlier work this paper cites.

“Evolving neural networks through augmenting topologies,”

Kenneth O Stanley and Risto Miikkulainen, · 2002

Earlier work this paper cites.

“Exploiting sparseness in deep neural networks for large vocabulary speech recognition,”

Dong Yu, Frank Seide, Gang Li, and Li Deng, · 2012

Earlier work this paper cites.

“Improving neural networks by preventing co-adaptation of feature detectors,”

Original

Geoffrey E Hinton, Nitish Srivastava, Alex Krizhevsky, Ilya Sutskever, and Ruslan R Salakhutdinov, · 2012

Earlier work this paper cites.

“Imagenet classification with deep convolutional neural networks,”

Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton, · 2012

Earlier work this paper cites.

“Regularization of neural networks using dropconnect,”

Li Wan, Matthew Zeiler, Sixin Zhang, Yann Le Cun, and Rob Fergus, · 2013

Cited alongside, same era.

“Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding,”

Original

Song Han, Huizi Mao, and William J Dally, · 2015

Cited alongside, same era.

“Learning both weights and connections for efficient neural network,”

Song Han, Jeff Pool, John Tran, and William Dally, · 2015

Cited alongside, same era.

“Quantized convolutional neural networks for mobile devices,”

Jiaxiang Wu, Cong Leng, Yuhang Wang, Qinghao Hu, and Jian Cheng, · 2016

Cited alongside, same era.

“Deep residual learning for image recognition,”

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun, · 2016

Cited alongside, same era.

“Cifar-10 (canadian institute for advanced research),”

“Pruning convolutional neural networks for resource efficient transfer learning,”

Original

Pavlo Molchanov, Stephen Tyree, Tero Karras, Timo Aila, and Jan Kautz, · 2016

Later among the works it cites.

“Exploring sparsity in recurrent neural networks,”

Original

Sharan Narang, Gregory Diamos, Shubho Sengupta, and Erich Elsen, · 2017

Later among the works it cites.

“Feature selection with annealing for computer vision and big data learning,”

Adrian Barbu, Yiyuan She, Liangjing Ding, and Gary Gramajo, · 2017

Later among the works it cites.

“Not all ops are created equal!,”

Original

Liangzhen Lai, Naveen Suda, and Vikas Chandra, · 2018

Closest in time.

“Learning structured sparsity in deep neural networks,”

Wei Wen, Chunpeng Wu, Yandan Wang, Yiran Chen, and Hai Li, · 2082

Closest in time.