Fetching the paper…
Reading the bibliography…
We present an efficient coresets-based neural network compression algorithm that sparsifies the parameters of a trained fully-connected neural network in a manner that provably approximates the network's output.
Extensions of lipschitz mappings into a hilbert space
William B Johnson and Joram Lindenstrauss · 1984
Earlier work this paper cites.
Optimal brain damage
Yann LeCun, John S Denker, and Sara A Solla · 1990
Earlier work this paper cites.
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998
Earlier work this paper cites.
Geometric approximation via coresets
Pankaj K Agarwal, Sariel Har-Peled, and Kasturi R Varadarajan · 2005
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky and Geoffrey Hinton · 2009
Earlier work this paper cites.
Hash kernels for structured data
Qinfeng Shi, James Petterson, Gideon Dror, John Langford, Alex Smola, and SVN Vishwanathan · 2009
Earlier work this paper cites.
Feature hashing for large scale multitask learning
Kilian Q. Weinberger, Anirban Dasgupta, Josh Attenberg, John Langford, and Alexander J. Smola · 2009
Earlier work this paper cites.
Universal
Michael Langberg and Leonard J Schulman · 2010
Earlier work this paper cites.
A note on element-wise matrix sparsification via a matrix-valued bernstein inequality
Petros Drineas and Anastasios Zouzias · 2011
Earlier work this paper cites.
A unified framework for approximating and clustering data
Dan Feldman and Michael Langberg · 2011
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012
Earlier work this paper cites.
Matrix entry-wise sampling: Simple is best
Dimitris Achlioptas, Zohar Karnin, and Edo Liberty · 2013
Earlier work this paper cites.
Predicting parameters in deep learning
Misha Denil, Babak Shakibi, Laurent Dinh, Marc Aurelio Ranzato, and Nando de Freitas · 2013
Earlier work this paper cites.
Exploiting linear structure within convolutional networks for efficient evaluation
Emily Denton, Wojciech Zaremba, Joan Bruna, Yann LeCun, and Rob Fergus · 2014
Earlier work this paper cites.
Compressing Deep Convolutional Networks using Vector Quantization
Yunchao Gong, Liu Liu, Ming Yang, and Lubomir Bourdev · 2014
Earlier work this paper cites.
Speeding up convolutional neural networks with low rank expansions
Max Jaderberg, Andrea Vedaldi, and Andrew Zisserman · 2014
Earlier work this paper cites.
A note on randomized element-wise matrix sparsification
Abhisek Kundu and Petros Drineas · 2014
Earlier work this paper cites.
Segnet: A deep convolutional encoder-decoder architecture for image segmentation
Vijay Badrinarayanan, Alex Kendall, and Roberto Cipolla · 2015
Cited alongside, same era.
An exploration of parameter redundancy in deep networks with circulant projections
Yu Cheng, Felix X Yu, Rogerio S Feris, Sanjiv Kumar, Alok Choudhary, and Shi-Fu Chang · 2015
Cited alongside, same era.
Song Han, Huizi Mao, and William J. Dally · 2015
Cited alongside, same era.
Training cnns with low-rank filters for efficient image classification
Yani Ioannou, Duncan Robertson, Jamie Shotton, Roberto Cipolla, and Antonio Criminisi · 2015
Cited alongside, same era.
Compression of deep convolutional neural networks for fast and low power mobile applications
Compression-aware training of deep networks
Jose M Alvarez and Mathieu Salzmann · 2017
Later among the works it cites.
Practical coreset constructions for machine learning
Olivier Bachem, Mario Lucic, and Andreas Krause · 2017
Later among the works it cites.
Spectrally-normalized margin bounds for neural networks
Peter L Bartlett, Dylan J Foster, and Matus J Telgarsky · 2017
Later among the works it cites.
Learning to prune deep neural networks via layer-wise optimal brain surgeon
Xin Dong, Shangyu Chen, and Sinno Pan · 2017
Later among the works it cites.
Gintare Karolina Dziugaite and Daniel M Roy · 2017
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Yong-Deok Kim, Eunhyeok Park, Sungjoo Yoo, Taelim Choi, Lu Yang, and Dongjun Shin · 2015
Cited alongside, same era.
Fully convolutional networks for semantic segmentation
Jonathan Long, Evan Shelhamer, and Trevor Darrell · 2015
Cited alongside, same era.
Structured transforms for small-footprint deep learning
Vikas Sindhwani, Tara Sainath, and Sanjiv Kumar · 2015
Cited alongside, same era.
Convolutional neural networks with low-rank regularization
Cheng Tai, Tong Xiao, Yi Zhang, Xiaogang Wang, et al · 2015
Cited alongside, same era.
New frameworks for offline and streaming coreset constructions
Vladimir Braverman, Dan Feldman, and Harry Lang · 2016
Cited alongside, same era.
Binary embeddings with structured hashed projections
Anna Choromanska, Krzysztof Choromanski, Mariusz Bojarski, Tony Jebara, Sanjiv Kumar, and Yann LeCun · 2016
Cited alongside, same era.
Coresets for scalable bayesian logistic regression
Jonathan H Huggins, Trevor Campbell, and Tamara Broderick · 2016
Cited alongside, same era.
Squeezenet: Alexnet-level accuracy with 50x fewer parameters and¡ 0.5 mb model size
Forrest N Iandola, Song Han, Matthew W Moskewicz, Khalid Ashraf, William J Dally, and Kurt Keutzer · 2016
Cited alongside, same era.
Runtime neural pruning
Ji Lin, Yongming Rao, Jiwen Lu, and Jie Zhou · 2017
Later among the works it cites.
Automatic differentiation in pytorch
Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer · 2017
Later among the works it cites.
Soft weight-sharing for neural network compression
Karen Ullrich, Edward Meeds, and Max Welling · 2017
Later among the works it cites.
Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms, 2017
Han Xiao, Kashif Rasul, and Roland Vollgraf · 2017
Later among the works it cites.
On compressing deep models by low rank and sparse decomposition
Xiyu Yu, Tongliang Liu, Xinchao Wang, and Dacheng Tao · 2017
Later among the works it cites.
Theoretical properties for neural networks with weight matrices of low displacement rank
Liang Zhao, Siyu Liao, Yanzhi Wang, Jian Tang, and Bo Yuan · 2017
Later among the works it cites.
Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights
Aojun Zhou, Anbang Yao, Yiwen Guo, Lin Xu, and Yurong Chen · 2017
Later among the works it cites.
Stronger generalization bounds for deep nets via a compression approach
Sanjeev Arora, Rong Ge, Behnam Neyshabur, and Yi Zhang · 2018
Closest in time.
Probabilistic tools for the analysis of randomized optimization heuristics
Benjamin Doerr · 2018
Closest in time.
Core dependency networks
Alejandro Molina, Alexander Munteanu, and Kristian Kersting · 2018
Closest in time.
Coresets-methods and history: A theoreticians design pattern for approximation and streaming algorithms
Alexander Munteanu and Chris Schwiegelshohn · 2018
Closest in time.
Compressibility and generalization in large-scale deep learning
Wenda Zhou, Victor Veitch, Morgane Austern, Ryan P Adams, and Peter Orbanz · 2018
Closest in time.