On Loss Functions for Deep Neural Networks in Classification

The mnist database of handwritten digits, 1998

Yann LeCun, Corinna Cortes, and Christopher JC Burges · 1998

Earlier work this paper cites.

Information theoretic learning

Jose C Principe, Dongxin Xu, and John Fisher · 2000

Earlier work this paper cites.

Exploring strategies for training deep neural networks

Hugo Larochelle, Yoshua Bengio, Jérôme Louradour, and Pascal Lamblin · 2009

Earlier work this paper cites.

Imagenet classification with deep convolutional neural networks

Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012

Earlier work this paper cites.

Deep learning using linear support vector machines

Original

Yichuan Tang · 2013

Earlier work this paper cites.

Adam: A method for stochastic optimization

Original

Diederik Kingma and Jimmy Ba · 2014

Cited alongside, same era.

Dropout: a simple way to prevent neural networks from overfitting

Nitish Srivastava, Geoffrey E Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov · 2014

Cited alongside, same era.

The loss surfaces of multilayer networks

Anna Choromanska, Mikael Henaff, Michael Mathieu, Gérard Ben Arous, and Yann LeCun · 2015

Cited alongside, same era.

Fast and accurate deep network learning by exponential linear units (elus)

Original

Djork-Arné Clevert, Thomas Unterthiner, and Sepp Hochreiter · 2015

Cited alongside, same era.

Maximum entropy linear manifold for learning discriminative low-dimensional representation

Wojciech Marian Czarnecki, Rafal Jozefowicz, and Jacek Tabor · 2015

Later among the works it cites.

Deeply-supervised nets

Chen-Yu Lee, Saining Xie, Patrick Gallagher, Zhengyou Zhang, and Zhuowen Tu · 2015

Later among the works it cites.

Wavenet: A generative model for raw audio

Original

Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu · 2016

Later among the works it cites.

Mastering the game of go with deep neural networks and tree search

David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George Van Den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, et al · 2016

Later among the works it cites.