Regularized Binary Network Training

Optimal brain damage

Yann LeCun, John S Denker, and Sara A Solla · 1990

Earlier work this paper cites.

Binaryconnect: Training deep neural networks with binary weights during propagations

Matthieu Courbariaux, Yoshua Bengio, and Jean-Pierre David · 2015

Earlier work this paper cites.

Deep compression: Compressing deep neural network with pruning, trained quantization and huffman coding

Original

Song Han, Huizi Mao, and William J. Dally · 2015

Earlier work this paper cites.

Deep residual learning for image recognition

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016

Earlier work this paper cites.

Bridging nonlinearities and stochastic regularizers with gaussian error linear units

Original

Dan Hendrycks and Kevin Gimpel · 2016

Earlier work this paper cites.

Xnor-net: Imagenet classification using binary convolutional neural networks

Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, and Ali Farhadi · 2016

Cited alongside, same era.

Trained ternary quantization

Original

Chenzhuo Zhu, Song Han, Huizi Mao, and William J. Dally · 2016

Cited alongside, same era.

Searching for activation functions

Original

Prajit Ramachandran, Barret Zoph, and Quoc V. Le · 2017

Cited alongside, same era.

How to train a compact binary neural network with high accuracy?

Wei Tang, Gang Hua, and Liang Wang · 2017

Cited alongside, same era.

Sigmoid-weighted linear units for neural network function approximation in reinforcement learning

Stefan Elfwing, Eiji Uchibe, and Kenji Doya · 2018

Closest in time.

Quantized neural networks: Training neural networks with low precision weights and activations

Itay Hubara, Matthieu Courbariaux, Daniel Soudry, Ran El-Yaniv, and Yoshua Bengio · 2018

Closest in time.

Bi-real net: Enhancing the performance of 1-bit cnns with improved representational capability and advanced training algorithm

Zechun Liu, Baoyuan Wu, Wenhan Luo, Xin Yang, Wei Liu, and Kwang-Ting Cheng · 2018

Closest in time.

Inverted residuals and linear bottlenecks: Mobile networks for classification, detection and segmentation

Original

Mark Sandler, Andrew G. Howard, Menglong Zhu, Andrey Zhmoginov, and Liang-Chieh Chen · 2018

Closest in time.