How transferable are features in deep neural networks?

Learning many related tasks at the same time with backpropagation

Caruana, R. (1995) · 1995

Earlier work this paper cites.

Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories

Fei-Fei, L., Fergus, R., and Perona, P. (2004) · 2004

Earlier work this paper cites.

ImageNet: A Large-Scale Hierarchical Image Database

Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009) · 2009

Earlier work this paper cites.

What is the best multi-stage architecture for object recognition?

Jarrett, K., Kavukcuoglu, K., Ranzato, M., and LeCun, Y. (2009) · 2009

Earlier work this paper cites.

Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations

Lee, H., Grosse, R., Ranganath, R., and Ng, A. Y. (2009) · 2009

Earlier work this paper cites.

ImageNet: A Large-Scale Hierarchical Image Database

Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009) · 2009

Earlier work this paper cites.

What is the best multi-stage architecture for object recognition?

Jarrett, K., Kavukcuoglu, K., Ranzato, M., and LeCun, Y. (2009) · 2009

Earlier work this paper cites.

Deep learning of representations for unsupervised and transfer learning

Bengio, Y. (2011) · 2011

Cited alongside, same era.

Deep learners benefit more from out-of-distribution examples

Bengio, Y., Bastien, F., Bergeron, A., Boulanger-Lewandowski, N., Breuel, T., Chherawala, Y., Cisse, M., Côté, M., Erhan, D., Eustache, J., Glorot, X., Muller, X., Pannetier Lebeuf, S., Pascanu, R., Rifai, S., Savard, F., and Sicard, G. (2011) · 2011

Cited alongside, same era.

ICA with reconstruction cost for efficient overcomplete feature learning

Le, Q. V., Karpenko, A., Ngiam, J., and Ng, A. Y. (2011) · 2011

Cited alongside, same era.

ImageNet classification with deep convolutional neural networks

Krizhevsky, A., Sutskever, I., and Hinton, G. (2012) · 2012

Cited alongside, same era.

Improving neural networks by preventing co-adaptation of feature detectors

Original

Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R. (2012) · 2012

Cited alongside, same era.

Visualizing and understanding convolutional networks

Zeiler, M. D. and Fergus, R. (2013) · 2013

Later among the works it cites.

Decaf: A deep convolutional activation feature for generic visual recognition

Original

Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., and Darrell, T. (2013) · 2013

Later among the works it cites.

Visualizing and understanding convolutional networks

Zeiler, M. D. and Fergus, R. (2013) · 2013

Later among the works it cites.

Caffe: Convolutional architecture for fast feature embedding

Original

Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (2014) · 2014

Closest in time.

Overfeat: Integrated recognition, localization and detection using convolutional networks

Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., and LeCun, Y. (2014) · 2014

Closest in time.