Fetching the paper…
Reading the bibliography…
We present a novel optimization strategy for training neural networks which we call "BitNet".
Asymptotically Efficient Quantizing
Herbert Gish and John Pierce · 1968
Earlier work this paper cites.
Gradient-Based Learning Applied To Document Recognition
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998
Earlier work this paper cites.
Learning Multiple Layers Of Features From Tiny Images
Alex Krizhevsky · 2009
Earlier work this paper cites.
Theano: A CPU and GPU Math Compiler in Python
James Bergstra, Olivier Breuleux, Frédéric Bastien, Pascal Lamblin, Razvan Pascanu, Guillaume Desjardins, Joseph Turian, David Warde-Farley, and Yoshua Bengio · 2010
Earlier work this paper cites.
Adaptive Subgradient Methods for Online Learning and Stochastic Optimization
John Duchi, Elad Hazan, and Yoram Singer · 2011
Earlier work this paper cites.
Learning Separable Filters
Roberto Rigamonti, Amos Sironi, Vincent Lepetit, and Pascal Fua · 2013
Earlier work this paper cites.
Regularization Of Neural Networks Using Dropconnect
Li Wan, Matthew Zeiler, Sixin Zhang, Yann L Cun, and Rob Fergus · 2013
Earlier work this paper cites.
Memory Bounded Deep Convolutional Networks
Maxwell D Collins and Pushmeet Kohli · 2014
Earlier work this paper cites.
Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
Emily L Denton, Wojciech Zaremba, Joan Bruna, Yann LeCun, and Rob Fergus · 2014
Earlier work this paper cites.
Compressing Deep Convolutional Networks Using Vector Quantization
Yunchao Gong, Liu Liu, Ming Yang, and Lubomir Bourdev · 2014
Earlier work this paper cites.
Adam: A Method For Stochastic Optimization
Diederik Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
BinaryConnect: Training Deep Neural Networks with Binary Weights During Propagations
Matthieu Courbariaux, Yoshua Bengio, and Jean-Pierre David · 2015
Earlier work this paper cites.
Deep Learning With Limited Numerical Precision
Suyog Gupta, Ankur Agrawal, Kailash Gopalakrishnan, and Pritish Narayanan · 2015
Earlier work this paper cites.
Batch Normalization: Accelerating Deep Network Training By Reducing Internal Covariate Shift
Sergey Ioffe and Christian Szegedy · 2015
Cited alongside, same era.
Neural Networks With Few Multiplications
Zhouhan Lin, Matthieu Courbariaux, Roland Memisevic, and Yoshua Bengio · 2015
Cited alongside, same era.
Convolutional Neural Networks With Low-Rank Regularization
Cheng Tai, Tong Xiao, Yi Zhang, Xiaogang Wang, et al · 2015
Cited alongside, same era.
Learning Separable Fixed-Point Kernels for Deep Convolutional Neural Networks
Sajid Anwar, Kyuyeon Hwang, and Wonyong Sung · 2016
Cited alongside, same era.
Towards the Limit of Network Quantization
Yoojin Choi, Mostafa El-Khamy, and Jungwon Lee · 2016
Deep Neural Networks Are Robust To Weight Binarization And Other Non-Linear Distortions
Paul Merolla, Rathinakumar Appuswamy, John Arthur, Steve K Esser, and Dharmendra Modha · 2016
Later among the works it cites.
Xnor-Net: Imagenet Classification Using Binary Convolutional Neural Networks
Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, and Ali Farhadi · 2016
Later among the works it cites.
Inception-V4, Inception-Resnet And The Impact Of Residual Connections On Learning
Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke, and Alex Alemi · 2016
Later among the works it cites.
Reducing The Model Order Of Deep Neural Networks Using Information Theory
Ming Tu, Visar Berisha, Yu Cao, and Jae-sun Seo · 2016
Later among the works it cites.
Accelerating Deep Convolutional Networks Using Low-Precision And Sparsity
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Understanding the impact of precision quantization on the accuracy and energy of neural networks
Soheil Hashemi, Nicholas Anthony, Hokchhay Tann, R Bahar, and Sherief Reda · 2016
Cited alongside, same era.
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Cited alongside, same era.
Quantized Neural Networks: Training Neural Networks With Low Precision Weights and Activations
Itay Hubara, Matthieu Courbariaux, Daniel Soudry, Ran El-Yaniv, and Yoshua Bengio · 2016
Cited alongside, same era.
Training Skinny Deep Neural Networks With Iterative Hard Thresholding Methods
Xiaojie Jin, Xiaotong Yuan, Jiashi Feng, and Shuicheng Yan · 2016
Cited alongside, same era.
Proteus: Exploiting Numerical Precision Variability In Deep Neural Networks
Patrick Judd, Jorge Albericio, Tayler Hetherington, Tor M Aamodt, Natalie Enright Jerger, and Andreas Moshovos · 2016
Cited alongside, same era.
Alternating Direction Method of Multipliers for Sparse Convolutional Neural Networks
Farkhondeh Kiaee, Christian Gagné, and Mahdieh Abbasi · 2016
Cited alongside, same era.
Pruning Filters For Efficient Convnets
Hao Li, Asim Kadav, Igor Durdanovic, Hanan Samet, and Hans Peter Graf · 2016
Cited alongside, same era.
Ganesh Venkatesh, Eriko Nurvitadhi, and Debbie Marr · 2016
Later among the works it cites.
Scalable Compression Of Deep Neural Networks
Xing Wang and Jie Liang · 2016
Later among the works it cites.
Training Ternary Neural Networks With Exact Proximal Operator
Penghang Yin, Shuai Zhang, Jack Xin, and Yingyong Qi · 2016
Later among the works it cites.
Chenzhuo Zhu, Song Han, Huizi Mao, and William J Dally · 2016
Later among the works it cites.
Soft-to-Hard Vector Quantization for End-to-End Learned Compression of Images and Neural Networks
Eirikur Agustsson, Fabian Mentzer, Michael Tschannen, Lukas Cavigelli, Radu Timofte, Luca Benini, and Luc Van Gool · 2017
Closest in time.
Mixed Low-Precision Deep Learning Inference Using Dynamic Fixed Point
Naveen Mellempudi, Abhisek Kundu, Dipankar Das, Dheevatsa Mudigere, and Bharat Kaul · 2017
Closest in time.
Two-Bit Networks For Deep Learning On Resource-Constrained Embedded Devices
Wenjia Meng, Zonghua Gu, Ming Zhang, and Zhaohui Wu · 2017
Closest in time.
Fixed-Point Optimization Of Deep Neural Networks With Adaptive Step Size Retraining
Sungho Shin, Yoonho Boo, and Wonyong Sung · 2017
Closest in time.
Soft Weight-Sharing For Neural Network Compression
Karen Ullrich, Edward Meeds, and Max Welling · 2017
Closest in time.