Multi-Bias Non-linear Activation in Deep Neural Networks

Reducing the dimensionality of data with neural networks

Hinton, G. E. and Salakhutdinov, R. R · 2006

Earlier work this paper cites.

Learning multiple layers of features from tiny images

Krizhevsky, Alex and Hinton, Geoffrey · 2009

Earlier work this paper cites.

Rectifier nonlinearities improve neural network acoustic models

Mass, Andrew L., Hannum, Awin Y., and Ng, Andew Y · 2010

Earlier work this paper cites.

Rectified linear units improve restricted boltzmann machines

Nair, Vinod and Hinton, Geoffrey E · 2010

Earlier work this paper cites.

Reading digits in natural images with unsupervised feature learning

Netzer, Yuval, Wang, Tao, Coates, Adam, Bissacco, Alessandro, Wu, Bo, and Ng, Andrew Y · 2011

Earlier work this paper cites.

Deep neural networks for acoustic modeling in speech recognition

Hinton, Geoffrey E., Deng, Li, Yu, Dong, Dahl, George E., Mohamed, Abdel-rahman, Jaitly, Navdeep, Senior, Andrew, Vanhoucke, Vincent, Nguyen, Patrick, Sainath, Tara N., and Kingsbury, Brian · 2012

Earlier work this paper cites.

Imagenet classification with deep convolutional neural networks

Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E · 2012

Earlier work this paper cites.

Invariant scattering convolution networks

Bruna, Joan and Mallat, Stephane · 2013

Earlier work this paper cites.

Maxout networks

Goodfellow, Ian J., Warde-farley, David, Mirza, Mehdi, Courville, Aaron, and Bengio, Yoshua · 2013

Cited alongside, same era.

Regularization of neural networks using dropconnect

Wan, Li, Zeiler, Matthew, Zhang, Sixin, Cun, Yann Le, and Fergus, Rob · 2013

Cited alongside, same era.

From maxout to channel-out: Encoding information on sparse pathways

Wang, Qi and JaJa, Joseph · 2013

Cited alongside, same era.

Stochastic pooling for regularization of deep convolutional neural networks

Original

Zeiler, Matthew D. and Fergus, Rob · 2013

Cited alongside, same era.

Deeply-supervised nets

Lee, Chen-Yu, Xie, Saining, Gallagher, Patrick, Zhang, Zhengyou, and Tu, Zhuowen · 2014

Cited alongside, same era.

Network in network

Lin, Min, Chen, Qiang, and Yan, Shuicheng · 2014

Cited alongside, same era.

Learning Activation Functions to Improve Deep Neural Networks

Agostinelli, Forest, Hoffman, Matthew, Sadowski, Peter, and Baldi, Pierre · 2015

Later among the works it cites.

Fast and accurate deep network learning by exponential linear units

Clevert, Djork-Arne, Unterthiner, Thomas, and Hochreiter, Sepp · 2015

Later among the works it cites.

Delving deep into rectifiers: Surpassing human-level performance on imagenet classification

He, Kaiming, Zhang, Xiangyu, Ren, Shaoqing, and Sun, Jian · 2015

Later among the works it cites.

Deep learning

LeCun, Y., Bengio, Y., and Hinton, G. E · 2015

Later among the works it cites.

Generalizing pooling functions in convolutional neural networks: Mixed, gated, and tree

Lee, Chen-Yu, Gallagher, Patrick W., and Tu, Zhuowen · 2015

Later among the works it cites.

Scalable bayesian optimization using deep neural networks

Snoek, Jasper, Rippel, Oren, Swersky, Kevin, Kiros, Ryan, Satish, Nadathur, Sundaram, Narayanan, Patwary, Mostofa, Prabhat, Mr, and Adams, Ryan · 2015