Fetching the paper…
Reading the bibliography…
This book chapter delves into the dynamics of continual learning, which is the process of incrementally learning from a non-stationary stream of data.
1902
Earlier work this paper cites.
1902
Earlier work this paper cites.
1903
Earlier work this paper cites.
1912
Earlier work this paper cites.
Heo, B., Kim, J., Yun, S., Park, H., Kwak, N. and Choi, J. Y. (2019), A comprehensive overhaul of feature distillation, in
1930
Earlier work this paper cites.
Grossberg, S. (1982), ‘Processing of expected and unexpected events during conditioning and attention: a psychophysiological theory.’, Psychological Review
1982
Earlier work this paper cites.
Hinton, G. E., McClelland, J. L. and Rumelhart, D. E. (1986), Distributed representations, in
1986
Earlier work this paper cites.
Nosofsky, R. M. (1986), ‘Attention, similarity, and the identification–categorization relationship.’, Journal of Experimental Psychology: General
1986
Earlier work this paper cites.
McCloskey, M. and Cohen, N. J. (1989), Catastrophic interference in connectionist networks: The sequential learning problem, in
1989
Earlier work this paper cites.
Ratcliff, R. (1990), ‘Connectionist models of recognition memory: constraints imposed by learning and forgetting functions.’, Psychological Review
1990
Earlier work this paper cites.
Lin, L.-J. (1992), ‘Self-improving reactive agents based on reinforcement learning, planning and teaching’, Machine Learning
1992
Earlier work this paper cites.
Wilson, M. A. and McNaughton, B. L. (1994), ‘Reactivation of hippocampal ensemble memories during sleep’, Science
1994
Earlier work this paper cites.
Robins, A. (1995), ‘Catastrophic forgetting, rehearsal and pseudorehearsal’, Connection Science
1995
Earlier work this paper cites.
Thrun, S. and Mitchell, T. M. (1995), ‘Lifelong robot learning’, Robotics and Autonomous Systems
1995
Earlier work this paper cites.
LeCun, Y., Bottou, L., Bengio, Y. and Haffner, P. (1998), ‘Gradient-based learning applied to document recognition’, Proceedings of the IEEE
1998
Earlier work this paper cites.
French, R. M. (1999), ‘Catastrophic forgetting in connectionist networks’, Trends in Cognitive Sciences
1999
Earlier work this paper cites.
Marder, E. and Thirumalai, V. (2002), ‘Cellular, synaptic and network effects of neuromodulation’, Neural Networks
2002
Earlier work this paper cites.
Morris, R. G. M. (2003), ‘Long-term potentiation and memory’, Philosophical Transactions of the Royal Society of London Series B-Biological Sciences
2003
Earlier work this paper cites.
2004
Earlier work this paper cites.
Wixted, J. T. (2004), ‘The psychology and neuroscience of forgetting’, Annual Review of Psychology
2004
Earlier work this paper cites.
Wiskott, L., Rasch, M. J. and Kempermann, G. (2006), ‘A functional hypothesis for adult hippocampal neurogenesis: avoidance of catastrophic interference in the dentate gyrus’, Hippocampus
2006
Earlier work this paper cites.
Rasch, B. and Born, J. (2007), ‘Maintaining memories by reactivation’, Current Opinion in Neurobiology
2007
Earlier work this paper cites.
Abraham, W. C. (2008), ‘Metaplasticity: tuning synapses and networks for plasticity’, Nature Reviews Neuroscience
2008
Earlier work this paper cites.
Sossin, W. S. (2008), Molecular memory traces, in
2008
Earlier work this paper cites.
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K. and Fei-Fei, L. (2009), ImageNet: A large-scale hierarchical image database, in
2009
Earlier work this paper cites.
Krizhevsky, A. (2009), Learning multiple layers of features from tiny images, Technical report, University of Toronto
2009
Earlier work this paper cites.
Rebuffi, S.-A., Kolesnikov, A., Sperl, G. and Lampert, C. H. (2017), iCaRL: Incremental classifier and representation learning, in
2010
Earlier work this paper cites.
Duchi, J., Hazan, E. and Singer, Y. (2011), ‘Adaptive subgradient methods for online learning and stochastic optimization.’, Journal of Machine Learning Research
2011
Earlier work this paper cites.
Netzer, Y., Wang, T., Coates, A., Bissacco, A., Wu, B. and Ng, A. Y. (2011), Reading digits in natural images with unsupervised feature learning, in
2011
Earlier work this paper cites.
Zhou, G., Sohn, K. and Lee, H. (2012), Online incremental feature learning with denoising autoencoders, in
2012
Earlier work this paper cites.
2013
Earlier work this paper cites.
Hardt, O., Nader, K. and Nadel, L. (2013), ‘Decay happens: the role of active forgetting in memory’, Trends in Cognitive Sciences
2013
Earlier work this paper cites.
Srivastava, R. K., Masci, J., Kazerounian, S., Gomez, F. and Schmidhuber, J. (2013), Compete to compute, in
2013
Earlier work this paper cites.
Aimone, J. B., Li, Y., Lee, S. W., Clemenson, G. D., Deng, W. and Gage, F. H. (2014), ‘Regulation and function of adult neurogenesis: from genes to cognition’, Physiological Reviews
2014
Earlier work this paper cites.
2014
Earlier work this paper cites.
Ellefsen, K. O., Mouret, J.-B. and Clune, J. (2015), ‘Neural modularity helps organisms evolve to learn new skills without forgetting old skills’, PLoS Computational Biology
2015
Earlier work this paper cites.
2015
Earlier work this paper cites.
Martens, J. and Grosse, R. (2015), Optimizing neural networks with kronecker-factored approximate curvature, in
2015
Earlier work this paper cites.
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G. et al. (2015), ‘Human-level control through deep reinforcement learning’, Nature
2015
Earlier work this paper cites.
Nørby, S. (2015), ‘Why forget? on the adaptive value of memory loss’, Perspectives on Psychological Science
2015
Earlier work this paper cites.
Terekhov, A. V., Montone, G. and O’Regan, J. K. (2015), Knowledge transfer in deep block-modular neural networks, in
2015
Earlier work this paper cites.
Zenke, F., Agnes, E. J. and Gerstner, W. (2015), ‘Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks’, Nature Communications
2015
Earlier work this paper cites.
2016
Earlier work this paper cites.
2016
Earlier work this paper cites.
Vinyals, O., Blundell, C., Lillicrap, T. and Wierstra, D. (2016), Matching networks for one shot learning, in
2016
Earlier work this paper cites.
Aljundi, R., Chakravarty, P. and Tuytelaars, T. (2017), Expert gate: Lifelong learning with a network of experts, in
2017
Earlier work this paper cites.
Alves, M. V. C. and Bueno, O. F. A. (2017), ‘Retroactive interference: forgetting as an interruption of memory consolidation’, Trends in Psychology
2017
Earlier work this paper cites.
Davis, R. L. and Zhong, Y. (2017), ‘The biology of forgetting—a perspective’, Neuron
2017
Earlier work this paper cites.
Draelos, T. J., Miner, N. E., Lamb, C. C., Cox, J. A., Vineyard, C. M., Carlson, K. D., Severa, W. M., James, C. D. and Aimone, J. B. (2017), Neurogenesis deep learning: Extending deep networks to accommodate new classes, in
2017
Earlier work this paper cites.
2017
Earlier work this paper cites.
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A. et al. (2017), ‘Overcoming catastrophic forgetting in neural networks’, Proceedings of the National Academy of Sciences
2017
Earlier work this paper cites.
Li, Z. and Hoiem, D. (2017), ‘Learning without forgetting’, IEEE Transactions on Pattern Analysis and Machine Intelligence
2017
Earlier work this paper cites.
Lopez-Paz, D. and Ranzato, M. (2017), Gradient episodic memory for continual learning, in
2017
Earlier work this paper cites.
Richards, B. A. and Frankland, P. W. (2017), ‘The persistence and transience of memory’, Neuron
2017
Earlier work this paper cites.
Shin, H., Lee, J. K., Kim, J. and Kim, J. (2017), Continual learning with deep generative replay, in
2017
Earlier work this paper cites.
Snell, J., Swersky, K. and Zemel, R. (2017), Prototypical networks for few-shot learning, in
2017
Earlier work this paper cites.
van Gerven, M. and Bohte, S. (2017), ‘Editorial: Artificial neural networks as models of neural information processing’, Frontiers in Computational Neuroscience
2017
Earlier work this paper cites.
Zenke, F., Poole, B. and Ganguli, S. (2017), Continual learning through synaptic intelligence, in
2017
Earlier work this paper cites.
Aljundi, R., Babiloni, F., Elhoseiny, M., Rohrbach, M. and Tuytelaars, T. (2018), Memory aware synapses: Learning what (not) to forget, in
2018
Cited alongside, same era.
2018
Cited alongside, same era.
Flesch, T., Balaguer, J., Dekker, R., Nili, H. and Summerfield, C. (2018), ‘Comparing continual task learning in minds and machines’, Proceedings of the National Academy of Sciences
2018
Cited alongside, same era.
2018
Cited alongside, same era.
Heald, J. B., Lengyel, M. and Wolpert, D. M. (2021), ‘Contextual inference underlies the learning of sensorimotor repertoires’, Nature
2021
Later among the works it cites.
Henning, C., Cervera, M. R., D’Angelo, F., von Oswald, J., Traber, R., Ehret, B., Kobayashi, S., Sacramento, J. and Grewe, B. F. (2021), Posterior meta-replay for continual learning, in
2021
Later among the works it cites.
Jin, X., Sadhu, A., Du, J. and Ren, X. (2021), Gradient-based editing of memory examples for online task-free continual learning, in
2021
Later among the works it cites.
Kao, T.-C., Jensen, K., van de Ven, G., Bernacchia, A. and Hennequin, G. (2021), Natural continual learning: success is a journey, not (just) a destination, in
2021
Later among the works it cites.
Laborieux, A., Ernoult, M., Hirtzlin, T. and Querlioz, D. (2021), ‘Synaptic metaplasticity in binarized neural networks’, Nature Communications
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2018
Cited alongside, same era.
Masse, N. Y., Grant, G. D. and Freedman, D. J. (2018), ‘Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilization’, Proceedings of the National Academy of Sciences
2018
Cited alongside, same era.
Nguyen, C. V., Li, Y., Bui, T. D. and Turner, R. E. (2018), Variational continual learning, in
2018
Cited alongside, same era.
Ritter, H., Botev, A. and Barber, D. (2018), Online structured laplace approximations for overcoming catastrophic forgetting, in
2018
Cited alongside, same era.
Schwarz, J., Czarnecki, W., Luketina, J., Grabska-Barwinska, A., Teh, Y. W., Pascanu, R. and Hadsell, R. (2018), Progress & compress: A scalable framework for continual learning, in
2018
Cited alongside, same era.
Serra, J., Suris, D., Miron, M. and Karatzoglou, A. (2018), Overcoming catastrophic forgetting with hard attention to the task, in
2018
Cited alongside, same era.
van de Ven, G. M. and Tolias, A. S. (2018), Three continual learning scenarios, in
2018
Cited alongside, same era.
Wu, C., Herranz, L., Liu, X., Wang, Y., van de Weijer, J. and Raducanu, B. (2018), Memory replay gans: learning to generate images from new categories without forgetting, in
2018
Cited alongside, same era.
2021
Later among the works it cites.
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J. et al. (2021), Learning transferable visual models from natural language supervision, in
2021
Later among the works it cites.
2021
Later among the works it cites.
Schug, S., Benzing, F. and Steger, A. (2021), ‘Presynaptic stochasticity improves energy efficiency and helps alleviate the stability-plasticity dilemma’, Elife
2021
Later among the works it cites.
2021
Later among the works it cites.
Soures, N., Helfer, P., Daram, A., Pandit, T. and Kudithipudi, D. (2021), TACOS: task agnostic continual learning in spiking neural networks, in
2021
Later among the works it cites.
2021
Later among the works it cites.
Tian, Y., Henaff, O. J. and van den Oord, A. (2021), Divide and contrast: Self-supervised learning from uncurated data, in
2021
Later among the works it cites.
van de Ven, G. M., Li, Z. and Tolias, A. S. (2021), Class-incremental learning with generative classifiers, in
2021
Later among the works it cites.
Verma, V. K., Liang, K. J., Mehta, N., Rai, P. and Carin, L. (2021), Efficient feature transformations for discriminative and generative continual learning, in
2021
Later among the works it cites.
Wei, K., Deng, C., Yang, X. and Li, M. (2021), Incremental embedding learning via zero-shot translation, in
2021
Later among the works it cites.
Yan, S., Xie, J. and He, X. (2021), DER: Dynamically expandable representation for class incremental learning, in
2021
Later among the works it cites.
Arani, E., Sarfraz, F. and Zonooz, B. (2022), Learning fast, learning slow: A general continual learning method based on complementary learning system, in
2022
Later among the works it cites.
De Lange, M., Aljundi, R., Masana, M., Parisot, S., Jia, X., Leonardis, A., Slabaugh, G. and Tuytelaars, T. (2022), ‘A continual learning survey: Defying forgetting in classification tasks’, IEEE Transactions on Pattern Analysis and Machine Intelligence
2022
Later among the works it cites.
Gomez-Villa, A., Twardowski, B., Yu, L., Bagdanov, A. D. and van de Weijer, J. (2022), Continually learning self-supervised representations with projected functional regularization, in
2022
Later among the works it cites.
Online blog, accessed on 22 Dec 2023. https://huyenchip.com/2022/01/02/real-time-machine-learning-challenges-and-solutions.html
Huyen, C. (2022), ‘Real-time machine learning: challenges and solutions’ · 2022
Later among the works it cites.
Joseph, K. J., Khan, S., Khan, F. S., Anwer, R. M. and Balasubramanian, V. N. (2022), Energy-based latent aligner for incremental learning, in
2022
Later among the works it cites.
Kim, G., Xiao, C., Konishi, T., Ke, Z. and Liu, B. (2022), A theoretical study on solving continual learning, in
2022
Later among the works it cites.
Kudithipudi, D., Aguilar-Simon, M., Babb, J., Bazhenov, M., Blackiston, D., Bongard, J., Brna, A. P., Chakravarthi Raja, S., Cheney, N., Clune, J. et al. (2022), ‘Biological underpinnings for lifelong learning machines’, Nature Machine Intelligence
2022
Later among the works it cites.
Li, S., Du, Y., van de Ven, G. and Mordatch, I. (2022), Energy-based models for continual learning, in
2022
Later among the works it cites.
Malviya, P., Ravindran, B. and Chandar, S. (2022), Tag: Task-based accumulated gradients for lifelong learning, in
2022
Later among the works it cites.
Mitchell, E., Lin, C., Bosselut, A., Finn, C. and Manning, C. D. (2022), Fast model editing at scale, in
2022
Later among the works it cites.
Mundt, M., Lang, S., Delfosse, Q. and Kersting, K. (2022), CLEVA-compass: A continual learning evaluation assessment compass to promote research transparency and comparability, in
2022
Later among the works it cites.
2022
Later among the works it cites.
Ostapenko, O., Lesort, T., Rodriguez, P., Arefin, M. R., Douillard, A., Rish, I. and Charlin, L. (2022), Continual learning with foundation models: An empirical study of latent replay, in
2022
Later among the works it cites.
Tadros, T., Krishnan, G. P., Ramyaa, R. and Bazhenov, M. (2022), ‘Sleep-like unsupervised replay reduces catastrophic forgetting in artificial neural networks’, Nature Communications
2022
Later among the works it cites.
van de Ven, G. M., Tuytelaars, T. and Tolias, A. S. (2022), ‘Three types of incremental learning’, Nature Machine Intelligence
2022
Later among the works it cites.
Boschini, M., Bonicelli, L., Buzzega, P., Porrello, A. and Calderara, S. (2023), ‘Class-incremental continual learning into the eXtended DER-Verse’, IEEE Transactions on Pattern Analysis and Machine Intelligence
2023
Later among the works it cites.
2023
Later among the works it cites.
De Lange, M., van de Ven, G. M. and Tuytelaars, T. (2023), Continual evaluation for lifelong learning: Identifying the stability gap, in
2023
Later among the works it cites.
Doerig, A., Sommers, R. P., Seeliger, K., Richards, B., Ismael, J., Lindsay, G. W., Kording, K. P., Konkle, T., Van Gerven, M. A., Kriegeskorte, N. and Kietzmann, T. C. (2023), ‘The neuroconnectionist research programme’, Nature Reviews Neuroscience
2023
Later among the works it cites.
2023
Later among the works it cites.
Flesch, T., Nagy, D. G., Saxe, A. and Summerfield, C. (2023), ‘Modelling continual learning in humans with hebbian context gating and exponentially decaying task signals’, PLOS Computational Biology
2023
Later among the works it cites.
Gao, Q., Zhao, C., Sun, Y., Xi, T., Zhang, G., Ghanem, B. and Zhang, J. (2023), A unified continual learning framework with general parameter-efficient tuning, in
2023
Later among the works it cites.
Guo, Y., Liu, B. and Zhao, D. (2023), Dealing with cross-task class discrimination in online continual learning, in
2023
Later among the works it cites.
Hemati, H., Cossu, A., Carta, A., Hurtado, J., Pellegrini, L., Bacciu, D., Lomonaco, V. and Borth, D. (2023), Class-incremental learning with repetition, in
2023
Later among the works it cites.
2023
Later among the works it cites.
Jeeveswaran, K., Bhat, P. S., Zonooz, B. and Arani, E. (2023), Birt: Bio-inspired replay in vision transformers for continual learning, in
2023
Later among the works it cites.
Kessler, S., Cobb, A., Rudner, T. G., Zohren, S. and Roberts, S. J. (2023), ‘On sequential bayesian inference for continual learning’, Entropy
2023
Later among the works it cites.
Khan, V., Cygert, S., Twardowski, B. and Trzciński, T. (2023), Looking through the past: better knowledge retention for generative replay in continual learning, in
2023
Later among the works it cites.
Klasson, M., Kjellstrom, H. and Zhang, C. (2023), ‘Learn the time to learn: Replay scheduling in continual learning’, Transactions on Machine Learning Research
2023
Later among the works it cites.
2023
Later among the works it cites.
Kudithipudi, D., Daram, A., Zyarah, A. M., Zohora, F. T., Aimone, J. B., Yanguas-Gil, A., Soures, N., Neftci, E., Mattina, M., Lomonaco, V. et al. (2023), ‘Design principles for lifelong learning AI accelerators’, Nature Electronics
2023
Later among the works it cites.
Masana, M., Liu, X., Twardowski, B., Menta, M., Bagdanov, A. D. and van de Weijer, J. (2023), ‘Class-incremental learning: survey and performance evaluation’, IEEE Transactions on Pattern Analysis and Machine Intelligence
2023
Later among the works it cites.
Survey Certification. https://openreview.net/forum?id=VynY6Bk03b
Mendez, J. A. and Eaton, E. (2023), ‘How to reuse and compose knowledge for a lifetime of tasks: A survey on continual learning and functional composition’, Transactions on Machine Learning Research · 2023
Later among the works it cites.
2023
Later among the works it cites.
Mundt, M., Hong, Y., Pliushch, I. and Ramesh, V. (2023), ‘A wholistic view of continual learning with deep neural networks: Forgotten lessons and the bridge to active and open world learning’, Neural Networks
2023
Later among the works it cites.
Prabhu, A., Al Kader Hammoud, H. A., Dokania, P. K., Torr, P. H., Lim, S.-N., Ghanem, B. and Bibi, A. (2023), Computationally budgeted continual learning: What does matter?, in
2023
Later among the works it cites.
Roy, K., Simon, C., Moghadam, P. and Harandi, M. (2023), ‘Subspace distillation for continual learning’, Neural Networks
2023
Later among the works it cites.
Tran Tung, L., Nguyen Van, V., Nguyen Hoang, P. and Than, K. (2023), Sharpness and gradient aware minimization for memory-based continual learning, in
2023
Later among the works it cites.
2023
Later among the works it cites.
Yang, E., Shen, L., Wang, Z., Liu, S., Guo, G. and Wang, X. (2023), Data augmented flatness-aware gradient projection for continual learning, in
2023
Later among the works it cites.
Zając, M., Tuytelaars, T. and van de Ven, G. M. (2024), Prediction error-based classification for class-incremental learning, in
2024
Closest in time.