Identity Mappings in Deep Residual Networks

Backpropagation applied to handwritten zip code recognition

LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: · 1989

Earlier work this paper cites.

Long short-term memory

Hochreiter, S., Schmidhuber, J.: · 1997

Earlier work this paper cites.

Learning multiple layers of features from tiny images

Krizhevsky, A.: · 2009

Earlier work this paper cites.

Rectified linear units improve restricted boltzmann machines

Nair, V., Hinton, G.E.: · 2010

Earlier work this paper cites.

Improving neural networks by preventing co-adaptation of feature detectors

Original

Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.R.: · 2012

Earlier work this paper cites.

Microsoft COCO: Common objects in context

Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., Zitnick, C.L.: · 2014

Earlier work this paper cites.

Fractional max-pooling

Original

Graham, B.: · 2014

Earlier work this paper cites.

Striving for simplicity: The all convolutional net

Original

Springenberg, J.T., Dosovitskiy, A., Brox, T., Riedmiller, M.: · 2014

Earlier work this paper cites.

Network in network

Lin, M., Chen, Q., Yan, S.: · 2014

Cited alongside, same era.

ImageNet Large Scale Visual Recognition Challenge

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A.C., Fei-Fei, L.: · 2015

Cited alongside, same era.

Highway networks

Srivastava, R.K., Greff, K., Schmidhuber, J.: · 2015

Cited alongside, same era.

Training very deep networks

Srivastava, R.K., Greff, K., Schmidhuber, J.: · 2015

Cited alongside, same era.

Batch normalization: Accelerating deep network training by reducing internal covariate shift

Ioffe, S., Szegedy, C.: · 2015

Cited alongside, same era.

Deeply-supervised nets

Lee, C.Y., Xie, S., Gallagher, P., Zhang, Z., Tu, Z.: · 2015

Cited alongside, same era.

Very deep convolutional networks for large-scale image recognition

Simonyan, K., Zisserman, A.: · 2015

Later among the works it cites.

Delving deep into rectifiers: Surpassing human-level performance on imagenet classification

He, K., Zhang, X., Ren, S., Sun, J.: · 2015

Later among the works it cites.

Deep residual learning for image recognition

He, K., Zhang, X., Ren, S., Sun, J.: · 2016

Closest in time.

Fast and accurate deep network learning by exponential linear units (ELUs)

Clevert, D.A., Unterthiner, T., Hochreiter, S.: · 2016

Closest in time.

All you need is a good init

Mishkin, D., Matas, J.: · 2016

Closest in time.

Rethinking the inception architecture for computer vision

Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: · 2016

Closest in time.