Understand
Many applications of mobile deep learning, especially real-time computer vision workloads, are constrained by computation power.
- This is particularly true for workloads running on older consumer phones, where a typical device might be powered by a single- or dual-core ARMv7 CPU.
- We provide an open-source implementation and a comprehensive analysis of (to our knowledge) the state of the art ultra-low-precision (<4 bit precision) implementation of the core primitives required for modern deep learning workloads on ARMv7 devices, and demonstrate speedups of 4x-20x over our additional state-of-the-art float32 and int8 baselines.
Built on
Fast convolutional nets with fbfft: A gpu performance evaluation
Nicolas Vasilache, Jeff Johnson, Michael Mathieu, Soumith Chintala, Serkan Piantino, and Yann LeCun · 2014
Earlier work this paper cites.
Blis: A framework for rapidly instantiating blas functionality
Field G. Van Zee and Robert A. van de Geijn · 2015
Earlier work this paper cites.
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks , pages 525–542
Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, and Ali Farhadi · 2016
Earlier work this paper cites.
Quantized neural networks: Training neural networks with low precision weights and activations
Itay Hubara, Matthieu Courbariaux, Daniel Soudry, Ran El-Yaniv, and Yoshua Bengio · 2016
Earlier work this paper cites.
Dorefa-net: Training low bitwidth convolutional neural networks with low bitwidth gradients
Shuchang Zhou, Yuxin Wu, Zekun Ni, Xinyu Zhou, He Wen, and Yuheng Zou · 2016
Earlier work this paper cites.
Similar
Training bit fully convolutional network for fast semantic segmentation
He Wen, Shuchang Zhou, Zhe Liang, Yuxiang Zhang, Dieqiao Feng, Xinyu Zhou, and Cong Yao · 2016
Cited alongside, same era.
Fast algorithms for convolutional neural networks
Andrew Lavin and Scott Gray · 2016
Cited alongside, same era.
Deep learning with low precision by half-wave gaussian quantization
Zhaowei Cai, Xiaodong He, Jian Sun, and Nuno Vasconcelos · 2017
Cited alongside, same era.
Mobilenets: Efficient convolutional neural networks for mobile vision applications
Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam · 2017
Cited alongside, same era.
gemmlowp
Google
Cited in the paper.
Then
Shufflenet: An extremely efficient convolutional neural network for mobile devices
Xiangyu Zhang, Xinyu Zhou, Mengxiao Lin, and Jian Sun · 2017
Closest in time.
Learning transferable architectures for scalable image recognition
Barret Zoph, Vijay Vasudevan, Jonathon Shlens, and Quoc V. Le · 2017
Closest in time.
Streamlined deployment for quantized neural networks
Yaman Umuroglu and Magnus Jahre · 2017
Closest in time.
Bmxnet: An open-source binary neural network implementation based on mxnet
Haojin Yang, Martin Fritzsche, Christian Bartz, and Christoph Meinel · 2017
Closest in time.
Beyond the bibliography
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…