Fetching the paper…
Reading the bibliography…
Through sequential construction of posteriors on observing data online, Bayes' theorem provides a natural framework for continual learning.
Catastrophic interference in connectionist networks: The sequential learning problem
McCloskey, M. and Cohen, N. J · 1989
Earlier work this paper cites.
Connectionist models of recognition memory: constraints imposed by learning and forgetting functions
Ratcliff, R · 1990
Earlier work this paper cites.
Continual learning in reinforcement environments
Ring, M. B · 1994
Earlier work this paper cites.
Lifelong learning algorithms
Thrun, S · 1998
Earlier work this paper cites.
An introduction to variational methods for graphical models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., and Saul, L. K · 1999
Earlier work this paper cites.
Expectation propagation for approximate bayesian inference
Minka, T. P · 2001
Earlier work this paper cites.
Online model selection based on the variational Bayes
Sato, M.-A · 2001
Earlier work this paper cites.
Gaussian processes: iterative sparse approximations
Csató, L · 2002
Earlier work this paper cites.
Sparse on-line Gaussian processes
Csató, L. and Opper, M · 2002
Earlier work this paper cites.
A unifying view of sparse approximate Gaussian process regression
Quiñonero-Candela, J. and Rasmussen, C. E · 2005
Earlier work this paper cites.
Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning)
Rasmussen, C. E. and Williams, C. K. I · 2005
Earlier work this paper cites.
Variational learning of inducing variables in sparse Gaussian processes
Titsias, M · 2009
Earlier work this paper cites.
Machine learning: a probabilistic perspective
Murphy, K. P · 2012
Earlier work this paper cites.
Streaming variational bayes
Broderick, T., Boyd, N., Wibisono, A., Wilson, A. C., and Jordan, M. I · 2013
Earlier work this paper cites.
Gaussian processes for big data
Hensman, J., Fusi, N., and Lawrence, N. D · 2013
Earlier work this paper cites.
Stochastic variational inference
Hoffman, M. D., Blei, D. M., Wang, C., and Paisley, J · 2013
Cited alongside, same era.
Social learning: an introduction to mechanisms, methods, and models
Hoppitt, W. and Laland, K. N · 2013
Cited alongside, same era.
Scalable variational gaussian process classification
Hensman, J., de G. Matthews, A. G., and Ghahramani, Z · 2015
Cited alongside, same era.
Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R., and Hadsell, R · 2016
Cited alongside, same era.
Deep kernel learning
Wilson, A. G., Hu, Z., Salakhutdinov, R., and Xing, E. P · 2016
Cited alongside, same era.
Streaming sparse gaussian process approximations
Bui, T. D., Nguyen, C. V., and Turner, R. E · 2017
Variational continual learning
Nguyen, C. V., Li, Y., Bui, T. D., and Turner, R. E · 2018
Later among the works it cites.
Online structured laplace approximations for overcoming catastrophic forgetting
Ritter, H., Botev, A., and Barber, D · 2018
Later among the works it cites.
Progress & compress: A scalable framework for continual learning
Schwarz, J., Czarnecki, W., Luketina, J., Grabska-Barwinska, A., Teh, Y. W., Pascanu, R., and Hadsell, R · 2018
Later among the works it cites.
Adaptive methods for nonconvex optimization
Zaheer, M., Reddi, S. J., Sachan, D. S., Kale, S., and Kumar, S · 2018
Later among the works it cites.
Uncertainty-based continual learning with adaptive regularization
Ahn, H., Cha, S., Lee, D., and Moon, T · 2019
Later among the works it cites.
Hierarchical Indian buffet neural networks for Bayesian continual learning
Kessler, S., Nguyen, V., Zohren, S., and Roberts, S · 2019
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al · 2017
Cited alongside, same era.
Learning without forgetting
Li, Z. and Hoiem, D · 2017
Cited alongside, same era.
Gradient episodic memory for continual learning
Lopez-Paz, D. and Ranzato, M · 2017
Cited alongside, same era.
icarl: Incremental classifier and representation learning
Rebuffi, S., Kolesnikov, A., Sperl, G., and Lampert, C. H · 2017
Cited alongside, same era.
Continual learning with deep generative replay
Shin, H., Lee, J. K., Kim, J., and Kim, J · 2017
Cited alongside, same era.
Continual learning through synaptic intelligence
Zenke, F., Poole, B., and Ganguli, S · 2017
Cited alongside, same era.
Later among the works it cites.
Continual multi-task Gaussian processes
Moreno-Muñoz, P., Artés-Rodríguez, A., and Álvarez, M. A · 2019
Later among the works it cites.
Pytorch: An imperative style, high-performance deep learning library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., Desmaison, A., Köpf, A., Yang, E., DeVito, Z., Raison, M., Tejani, A., Chilamkurthy, S., Steiner, B., Fang, L., Bai, J., and Chintala, S · 2019
Later among the works it cites.
Improving and understanding variational continual learning
Swaroop, S., Nguyen, C. V., Bui, T. D., and Turner, R. E · 2019
Later among the works it cites.
Three scenarios for continual learning
van de Ven, G. M. and Tolias, A. S · 2019
Later among the works it cites.
Sparse orthogonal variational inference for gaussian processes
Shi, J., Titsias, M. K., and Mnih, A · 2020
Closest in time.
Functional regularisation for continual learning with gaussian processes
Titsias, M. K., Schwarz, J., de G. Matthews, A. G., Pascanu, R., and Teh, Y. W · 2020
Closest in time.
How good is the bayes posterior in deep neural networks really?
Wenzel, F., Roth, K., Veeling, B. S., Swiatkowski, J., Tran, L., Mandt, S., Snoek, J., Salimans, T., Jenatton, R., and Nowozin, S · 2020
Closest in time.
Bayesian deep learning and a probabilistic perspective of generalization
Wilson, A. G. and Izmailov, P · 2020
Closest in time.