Continual Learning with Deep Generative Replay

Using fast weights to deblur old memories

G. E. Hinton and D. C. Plaut · 1987

Earlier work this paper cites.

Catastrophic interference in connectionist networks: The sequential learning problem

M. McCloskey and N. J. Cohen · 1989

Earlier work this paper cites.

Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions

R. Ratcliff · 1990

Earlier work this paper cites.

Infants’ ability to draw inferences about nonobvious object properties: Evidence from exploratory play

D. A. Baldwin, E. M. Markman, and R. L. Melartin · 1993

Earlier work this paper cites.

Catastrophic forgetting in neural networks: the role of rehearsal mechanisms

A. Robins · 1993

Earlier work this paper cites.

Catastrophic forgetting, rehearsal and pseudorehearsal

A. Robins · 1995

Earlier work this paper cites.

Avoiding catastrophic forgetting by coupling two reverberating neural networks

B. Ans and S. Rousset · 1997

Earlier work this paper cites.

Gradient-based learning applied to document recognition

Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner · 1998

Earlier work this paper cites.

Catastrophic forgetting in connectionist networks

R. M. French · 1999

Earlier work this paper cites.

Ensemble methods in machine learning

T. G. Dietterich · 2000

Earlier work this paper cites.

Long-term dendritic spine stability in the adult cortex

J. Grutzendler, N. Kasthuri, and W.-B. Gan · 2002

Earlier work this paper cites.

Hippocampal and neocortical contributions to memory: Advances in the complementary learning systems framework

R. C. O’Reilly and K. A. Norman · 2002

Earlier work this paper cites.

Memory retention–the synaptic stability versus plasticity dilemma

W. C. Abraham and A. Robins · 2005

Cited alongside, same era.

Evidence for large long-term memory capacities in baboons and pigeons and its implications for learning and the evolution of cognition

J. Fagot and R. G. Cook · 2006

Cited alongside, same era.

Sleep-dependent memory consolidation and reconsolidation

R. Stickgold and M. P. Walker · 2007

Cited alongside, same era.

Internally generated reactivation of single neurons in human hippocampus during free recall

H. Gelbard-Sagiv, R. Mukamel, M. Harel, R. Malach, and I. Fried · 2008

Cited alongside, same era.

Deep boltzmann machines

R. Salakhutdinov and G. Hinton · 2009

Cited alongside, same era.

The development of object categorization in young children: Hierarchical inclusiveness, age, perceptual attribute, and group versus individual analyses

Rich feature hierarchies for accurate object detection and semantic segmentation

R. Girshick, J. Donahue, T. Darrell, and J. Malik · 2014

Later among the works it cites.

Generative adversarial nets

I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio · 2014

Later among the works it cites.

A biologically inspired dual-network memory model for reduction of catastrophic forgetting

M. Hattori · 2014

Later among the works it cites.

Dropout: a simple way to prevent neural networks from overfitting

N. Srivastava, G. E. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov · 2014

Later among the works it cites.

Human-level control through deep reinforcement learning

V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski, et al · 2015

Later among the works it cites.

Learning without forgetting

Z. Li and D. Hoiem · 2016