Understand
Deep Neural Networks are becoming increasingly popular in always-on IoT edge devices performing data analytics right at the source, reducing latency as well as energy consumption for data communication.
- This paper presents CMSIS-NN, efficient kernels developed to maximize the performance and minimize the memory footprint of neural network (NN) applications on Arm Cortex-M processors targeted for intelligent IoT edge devices.
- Neural network inference based on CMSIS-NN kernels achieves 4.6X improvement in runtime/throughput and 4.9X improvement in energy efficiency.
Built on
Caffe: Convolutional architecture for fast feature embedding
Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell · 2014
Earlier work this paper cites.
https://petewarden.com/2015/04/20/why-gemm-is-at-the-heart-of-deep-learning/
2015
Earlier work this paper cites.
Edge computing: Vision and challenges
Weisong Shi, Jie Cao, Quan Zhang, Youhuizi Li, and Lanyu Xu · 2016
Earlier work this paper cites.
Tensorflow: Large-scale machine learning on heterogeneous distributed systems
Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, et al · 2016
Earlier work this paper cites.
Similar
Fixed point quantization of deep convolutional networks
Darryl Lin, Sachin Talathi, and Sreekanth Annapureddy · 2016
Cited alongside, same era.
Throughput-optimized opencl-based fpga accelerator for large-scale convolutional neural networks
Naveen Suda, Vikas Chandra, Ganesh Dasika, Abinash Mohanty, Yufei Ma, Sarma Vrudhula, Jae-sun Seo, and Yu Cao · 2016
Cited alongside, same era.
Optimizing memory efficiency for deep convolutional neural networks on gpus
Chao Li, Yi Yang, Min Feng, Srimat Chakradhar, and Huiyang Zhou · 2016
Cited alongside, same era.
The route to a trillion devices
Philip Sparks
Cited in the paper.
https://github.com/ARM-software/CMSIS_5
Cited in the paper.
http://www.arm.com/products/processors/cortex-m
Cited in the paper.
http://www.st.com/en/evaluation-tools/nucleo-f746zg.html
Nucleo-f746zg development board
Cited in the paper.
Then
Deep convolutional neural network inference with floating-point weights and fixed-point activations
Liangzhen Lai, Naveen Suda, and Vikas Chandra · 2017
Later among the works it cites.
Mobilenets: Efficient convolutional neural networks for mobile vision applications
Andrew G Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam · 2017
Later among the works it cites.
Hello edge: Keyword spotting on microcontrollers
Yundong Zhang, Naveen Suda, Liangzhen Lai, and Vikas Chandra · 2017
Later among the works it cites.
Beyond the bibliography
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…