On Signal-to-Noise Ratio Issues in Variational Inference for Deep Gaussian Processes

Individual comparisons by ranking methods

Wilcoxon, F · 1992

Earlier work this paper cites.

Simple statistical gradient-following algorithms for connectionist reinforcement learning

Williams, R. J · 1992

Earlier work this paper cites.

Application of bayesian approach to numerical methods of global and stochastic optimization

Mockus, J · 1994

Earlier work this paper cites.

Gaussian Processes for Machine Learning

Rasmussen, C. E. and Williams, C. K. I · 2006

Earlier work this paper cites.

Understanding the difficulty of training deep feedforward neural networks

Glorot, X. and Bengio, Y · 2010

Earlier work this paper cites.

Deep Gaussian processes

Damianou, A. and Lawrence, N · 2013

Earlier work this paper cites.

Stochastic variational inference

Hoffman, M. D., Blei, D. M., Wang, C., and Paisley, J · 2013

Earlier work this paper cites.

Auto-encoding variational bayes

Original

Kingma, D. P. and Welling, M · 2013

Cited alongside, same era.

Scalable variational Gaussian process classification

Hensman, J., de G. Matthews, A. G., and Ghahramani, Z · 2014

Cited alongside, same era.

Adam: A method for stochastic optimization

Kingma, D. P. and Ba, J · 2015

Cited alongside, same era.

Kernel interpolation for scalable structured Gaussian processes (KISS-GP)

Wilson, A. and Nickisch, H · 2015

Cited alongside, same era.

Deep Gaussian processes for regression using approximate expectation propagation

Bui, T., Hernandez-Lobato, D., Hernandez-Lobato, J., Li, Y., and Turner, R · 2016

Cited alongside, same era.

Importance weighted autoencoders

Burda, Y., Grosse, R. B., and Salakhutdinov, R · 2016

UCI machine learning repository, 2017

Dua, D. and Graff, C · 2017

Later among the works it cites.

Doubly stochastic variational inference for deep Gaussian processes

Salimbeni, H. and Deisenroth, M · 2017

Later among the works it cites.

Importance weighting and variational inference

Domke, J. and Sheldon, D. R · 2018

Later among the works it cites.

Inference in deep Gaussian processes using stochastic gradient Hamiltonian Monte Carlo

Havasi, M., Hernández-Lobato, J. M., and Murillo-Fuentes, J. J · 2018

Later among the works it cites.

Deep Gaussian processes with importance-weighted variational inference

Salimbeni, H., Dutordoir, V., Hensman, J., and Deisenroth, M. P · 2019

Later among the works it cites.

Doubly reparameterized gradient estimators for Monte Carlo objectives

Tucker, G., Lawson, D., Gu, S., and Maddison, C. J · 2019