Fetching the paper…
Reading the bibliography…
Incremental learning suffers from two challenging problems; forgetting of old knowledge and intransigence on learning new knowledge.
Information theory and statistical mechanics
Jaynes, E. T · 1957
Earlier work this paper cites.
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M. and Neal · 1989
Earlier work this paper cites.
Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions
Ratcliff, R · 1990
Earlier work this paper cites.
Curriculum learning
Bengio, Y., Louradour, J., Collobert, R., and Weston, J · 2009
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Krizhevsky, A · 2009
Earlier work this paper cites.
Self-paced learning for latent variable models
Kumar, M. P., Packer, B., and Koller, D · 2010
Earlier work this paper cites.
ImageNet Classification with Deep Convolutional Neural Networks
Krizhevsky, A., Sutskever, I., and Hinton, G. E · 2012
Earlier work this paper cites.
Distilling the knowledge in a neural network
Hinton, G., Vinyals, O., and Dean, J · 2015
Earlier work this paper cites.
Self-paced curriculum learning
Jiang, L., Meng, D., Zhao, Q., Shan, S., and Hauptmann, A · 2015
Earlier work this paper cites.
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A · 2015
Earlier work this paper cites.
Unsupervised training of maximum-entropy models for lexical selection in rule-based machine translation
Tyers, F. M., Sánchez-Martínez, F., and Forcada, M. L · 2015
Earlier work this paper cites.
Learning online alignments with continuous rewards policy gradient
Luo, Y., Chiu, C., Jaitly, N., and Sutskever, I · 2016
Cited alongside, same era.
Asynchronous methods for deep reinforcement learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., and Kavukcuoglu, K · 2016
Cited alongside, same era.
Reward augmented maximum likelihood for neural structured prediction
Norouzi, M., Bengio, S., Chen, Z., Jaitly, N., Schuster, M., Wu, Y., and Schuurmans, D · 2016
Cited alongside, same era.
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., Dieleman, S., Grewe, D., Nham, J., Kalchbrenner, N., Sutskever, I., Lillicrap, T., Leach, M., Kavukcuoglu, K., Graepel, T., and Hassabis, D · 2016
Cited alongside, same era.
Densely connected convolutional networks
Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K. Q · 2017
Cited alongside, same era.
Continual learning through synaptic intelligence
Zenke, F., Poole, B., and Ganguli, S · 2017
Later among the works it cites.
Memory aware synapses: Learning what (not) to forget
Aljundi, R., Babiloni, F., Elhoseiny, M., Rohrbach, M., and Tuytelaars, T · 2018
Later among the works it cites.
Deesil: Deep-shallow incremental learning
Belouadah, E. and Popescu, A · 2018
Later among the works it cites.
End-to-end incremental learning
Castro, F. M., Marin-Jimenez, M. J., Guil, N., Schmid, C., and Alahari, K · 2018
Later among the works it cites.
Riemannian walk for incremental learning: Understanding forgetting and intransigence
Chaudhry, A., Dokania, P. K., Ajanthan, T., and Torr, P. H. S · 2018
Later among the works it cites.
BERT: pre-training of deep bidirectional transformers for language understanding
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N. C., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., Hassabis, D., Clopath, C., Kumaran, D., and Hadsell, R · 2017
Cited alongside, same era.
Lifelong learning with dynamically expandable networks
Lee, J., Yoon, J., Yang, E., and Hwang, S. J · 2017
Cited alongside, same era.
Learning without forgetting
Li, Z. and Hoiem, D · 2017
Cited alongside, same era.
Packnet: Adding multiple tasks to a single network by iterative pruning
Mallya, A. and Lazebnik, S · 2017
Cited alongside, same era.
Regularizing neural networks by penalizing confident output distributions
Pereyra, G., Tucker, G., Chorowski, J., Kaiser, L., and Hinton, G. E · 2017
Cited alongside, same era.
icarl: Incremental classifier and representation learning
Rebuffi, S.-A., Kolesnikov, A., Sperl, G., and Lampert, C. H · 2017
Cited alongside, same era.
URL https://tiny-imagenet.herokuapp.com
Tiny imagenet visual recognition challenge
Cited in the paper.
Devlin, J., Chang, M., Lee, K., and Toutanova, K · 2018
Later among the works it cites.
Born again neural networks
Furlanello, T., Lipton, Z. C., Tschannen, M., Itti, L., and Anandkumar, A · 2018
Later among the works it cites.
Fearnet: Brain-inspired model for incremental learning
Kemker, R. and Kanan, C · 2018
Later among the works it cites.
Piggyback: Adapting a single network to multiple tasks by learning to mask weights
Mallya, A., Davis, D., and Lazebnik, S · 2018
Later among the works it cites.
Overcoming catastrophic forgetting with hard attention to the task
Serra, J., Suris, D., Miron, M., and Karatzoglou, A · 2018
Later among the works it cites.