Fetching the paper…
Reading the bibliography…
In order to contrast the explosion in size of state-of-the-art machine learning models that can be attributed to the empirical advantages of over-parametrization, and due to the necessity of deploying fast, sustainable, and private on-device models on resource-constrained devices, the community has focused on techniques such as pruning, quantization, and distillation as central strategies for model compression.
Histologie du système nerveux de l’homme et des vertébrés. , volume v. 1
S. Ramón y Cajal · 1909
Earlier work this paper cites.
Gradient-based learning applied to document recognition
Y. LeCun et al · 1998
Earlier work this paper cites.
Brain connectivity
O. Sporns · 2007
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition, 2014
Karen Simonyan and Andrew Zisserman · 2014
Earlier work this paper cites.
Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding, 2015
S. Han, H. Mao, and W. J. Dally · 2015
Earlier work this paper cites.
Compression of deep convolutional neural networks for fast and low power mobile applications, 2015
Y.-D. Kim et al · 2015
Cited alongside, same era.
Squeezenet: Alexnet-level accuracy with 50x fewer parameters and ¡0.5mb model size, 2016
F. N. Iandola et al · 2016
Cited alongside, same era.
Minerva: Enabling low-power, highly-accurate deep neural network accelerators
B. Reagen, P. Whatmough, R. Adolf, S. Rama, H. Lee, S. K. Lee, J. M. Hernández-Lobato, G. Wei, and D. Brooks · 2016
Cited alongside, same era.
Embedded deep neural network processing: Algorithmic and processor techniques bring deep learning to iot and edge devices
M. Verhelst and B. Moons · 2017
Cited alongside, same era.
Designing energy-efficient convolutional neural networks using energy-aware pruning
T.-J. Yang, Y.-H. Chen, and V. Sze · 2017
Cited alongside, same era.
Nullanet: Training deep neural networks for reduced-memory-access inference
M. Nazemi, G. Pasandi, and M. Pedram · 2018
Later among the works it cites.
Pytorch: An imperative style, high-performance deep learning library
A. Paszke et al · 2019
Later among the works it cites.
Green ai, 2019
R. Schwartz et al · 2019
Later among the works it cites.
Energy and policy considerations for deep learning in nlp, 2019
E. Strubell, A. Ganesh, and A. McCallum · 2019
Later among the works it cites.
Towards the systematic reporting of the energy and carbon footprints of machine learning
P. Henderson et al · 2020
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…