Parameter-Level Soft-Masking for Continual Learning

Learning Multiple Layers of Features from Tiny Images, 2009

Krizhevsky, A. and Hinton, G · 2009

Earlier work this paper cites.

Algorithms for Hyper-Parameter Optimization

Bergstra, J., Bardenet, R., Bengio, Y., and Kégl, B · 2011

Earlier work this paper cites.

ImageNet Classification with Deep Convolutional Neural Networks

Krizhevsky, A., Sutskever, I., and Hinton, G. E · 2012

Earlier work this paper cites.

Deep Learning Face Attributes in the Wild

Liu, Z., Luo, P., Wang, X., and Tang, X · 2015

Earlier work this paper cites.

ImageNet Large Scale Visual Recognition Challenge

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A. C., and Fei-Fei, L · 2015

Earlier work this paper cites.

Learning without Forgetting

Li, Z. and Hoiem, D · 2016

Earlier work this paper cites.

Progressive Neural Networks, 2016

Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R., and Hadsell, R · 2016

Earlier work this paper cites.

PathNet: Evolution Channels Gradient Descent in Super Neural Networks, 2017

Fernando, C., Banarse, D., Blundell, C., Zwols, Y., Ha, D., Rusu, A. A., Pritzel, A., and Wierstra, D · 2017

Earlier work this paper cites.

Overcoming catastrophic forgetting in neural networks

Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., Hassabis, D., Clopath, C., Kumaran, D., and Hadsell, R · 2017

Earlier work this paper cites.

Gradient Episodic Memory for Continual Learning

Lopez-Paz, D. and Ranzato, M · 2017

Earlier work this paper cites.

iCaRL: Incremental Classifier and Representation Learning

Rebuffi, S.-A., Kolesnikov, A., Sperl, G., and Lampert, C. H · 2017

Cited alongside, same era.

Continual Learning with Deep Generative Replay

Shin, H., Lee, J. K., Kim, J., and Kim, J · 2017

Cited alongside, same era.

Tiny ImageNet Challenge, 2017

Wu, J., Zhang, Q., and Xu, G · 2017

Cited alongside, same era.

Continual Learning Through Synaptic Intelligence

Zenke, F., Poole, B., and Ganguli, S · 2017

Cited alongside, same era.

PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning

Mallya, A. and Lazebnik, S · 2018

Cited alongside, same era.

Overcoming Catastrophic Forgetting with Hard Attention to the Task

Serra, J., Suris, D., Miron, M., and Karatzoglou, A · 2018

Cited alongside, same era.

Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interference

Riemer, M., Cases, I., Ajemian, R., Liu, M., Rish, I., Tu, Y., and Tesauro, G · 2019

Later among the works it cites.

Continual Learning of a Mixed Sequence of Similar and Dissimilar Tasks

Ke, Z., Liu, B., and Huang, X · 2020

Later among the works it cites.

Supermasks in Superposition

Wortsman, M., Ramanujan, V., Liu, R., Kembhavi, A., Rastegari, M., Yosinski, J., and Farhadi, A · 2020

Later among the works it cites.

Scalable and Order-robust Continual Learning with Additive Parameter Decomposition

Yoon, J., Kim, S., Yang, E., and Hwang, S. J · 2020

Later among the works it cites.

Class-incremental Learning via Deep Model Consolidation

Zhang, J., Zhang, J., Ghosh, S., Li, D., Tasci, S., Heck, L., Zhang, H., and Kuo, C. C. J · 2020

Later among the works it cites.

BinPlay: A Binary Latent Autoencoder for Generative Replay Continual Learning