PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning

Catastrophic forgetting in connectionist networks

R. M. French · 1999

Earlier work this paper cites.

Automated flower classification over a large number of classes

M.-E. Nilsback and A. Zisserman · 2008

Earlier work this paper cites.

The Caltech-UCSD Birds-200-2011 Dataset

C. Wah, S. Branson, P. Welinder, P. Perona, and S. Belongie · 2011

Earlier work this paper cites.

3d object representations for fine-grained categorization

J. Krause, M. Stark, J. Deng, and L. Fei-Fei · 2013

Earlier work this paper cites.

Distilling the knowledge in a neural network

G. Hinton, O. Vinyals, and J. Dean · 2014

Earlier work this paper cites.

Very deep convolutional networks for large-scale image recognition

Original

K. Simonyan and A. Zisserman · 2014

Earlier work this paper cites.

Deep learning with limited numerical precision

S. Gupta, A. Agrawal, K. Gopalakrishnan, and P. Narayanan · 2015

Earlier work this paper cites.

Learning both weights and connections for efficient neural network

S. Han, J. Pool, J. Tran, and W. Dally · 2015

Earlier work this paper cites.

Batch normalization: Accelerating deep network training by reducing internal covariate shift

S. Ioffe and C. Szegedy · 2015

Earlier work this paper cites.

ImageNet Large Scale Visual Recognition Challenge

O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei · 2015

Earlier work this paper cites.

Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding

S. Han, H. Mao, and W. J. Dally · 2016

Cited alongside, same era.

Deep residual learning for image recognition

K. He, X. Zhang, S. Ren, and J. Sun · 2016

Cited alongside, same era.

Binarized neural networks

I. Hubara, M. Courbariaux, D. Soudry, R. El-Yaniv, and Y. Bengio · 2016

Cited alongside, same era.

Learning without forgetting

Z. Li and D. Hoiem · 2016

Cited alongside, same era.

Xnor-net: Imagenet classification using binary convolutional neural networks

M. Rastegari, V. Ordonez, J. Redmon, and A. Farhadi · 2016

Cited alongside, same era.

Progressive neural networks

Original

A. A. Rusu, N. C. Rabinowitz, G. Desjardins, H. Soyer, J. Kirkpatrick, K. Kavukcuoglu, R. Pascanu, and R. Hadsell · 2016

Densely connected convolutional networks

G. Huang, Z. Liu, L. van der Maaten, and K. Q. Weinberger · 2017

Closest in time.

Overcoming catastrophic forgetting in neural networks

J. Kirkpatrick, R. Pascanu, N. Rabinowitz, J. Veness, G. Desjardins, A. A. Rusu, K. Milan, J. Quan, T. Ramalho, A. Grabska-Barwinska, et al · 2017

Closest in time.

Overcoming catastrophic forgetting by incremental moment matching

S.-W. Lee, J.-H. Kim, J.-W. Ha, and B.-T. Zhang · 2017

Closest in time.

Pruning filters for efficient convnets

H. Li, A. Kadav, I. Durdanovic, H. Samet, and H. P. Graf · 2017

Closest in time.

Learning efficient convolutional networks through network slimming

Z. Liu, J. Li, Z. Shen, G. Huang, S. Yan, and C. Zhang · 2017

Closest in time.

Pruning convolutional neural networks for resource efficient inference

P. Molchanov, S. Tyree, T. Karras, T. Aila, and J. Kautz · 2017

Closest in time.