Fetching the paper…
Reading the bibliography…
The reparameterization gradient has become a widely used method to obtain Monte Carlo gradients to optimize the variational objective.
A useful theorem for nonlinear devices having Gaussian inputs
Price, R. (1958) · 1958
Earlier work this paper cites.
Transformations des signaux aléatoires a travers les systemes non linéaires sans mémoire
Bonnet, G. (1964) · 1964
Earlier work this paper cites.
Likelihood ratio gradient estimation for stochastic systems
Glynn, P. W. (1990) · 1990
Earlier work this paper cites.
Connectionist learning of belief networks
Neal, R. (1992) · 1992
Earlier work this paper cites.
Simple statistical gradient-following algorithms for connectionist reinforcement learning
Williams, R. J. (1992) · 1992
Earlier work this paper cites.
The wake-sleep algorithm for unsupervised neural networks
Hinton, G., Dayan, P., Frey, B. J., and Neal, R. M. (1995) · 1995
Earlier work this paper cites.
Rao-Blackwellisation of sampling schemes
Casella, G. and Robert, C. P. (1996) · 1996
Earlier work this paper cites.
An introduction to variational methods for graphical models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., and Saul, L. K. (1999) · 1999
Earlier work this paper cites.
Propagation algorithms for variational Bayesian learning
Ghahramani, Z. and Beal, M. J. (2001) · 2001
Earlier work this paper cites.
Simulation
Ross, S. M. (2002) · 2002
Earlier work this paper cites.
Graphical models, exponential families, and variational inference
Wainwright, M. J. and Jordan, M. I. (2008) · 2008
Earlier work this paper cites.
A stochastic approximation method for inference in probabilistic graphical models
Carbonetto, P., King, M., and Hamze, F. (2009) · 2009
Earlier work this paper cites.
Adaptive subgradient methods for online learning and stochastic optimization
Duchi, J., Hazan, E., and Singer, Y. (2011) · 2011
Cited alongside, same era.
Variational Bayesian inference with stochastic search
Paisley, J. W., Blei, D. M., and Jordan, M. I. (2012) · 2012
Cited alongside, same era.
Lecture 6.5-RMSPROP: Divide the gradient by a running average of its recent magnitude
Tieleman, T. and Hinton, G. (2012) · 2012
Cited alongside, same era.
Fixed-form variational posterior approximation through stochastic linear regression
Salimans, T. and Knowles, D. A. (2013) · 2013
Cited alongside, same era.
Automated variational inference in probabilistic programming
Wingate, D. and Weber, T. (2013) · 2013
Cited alongside, same era.
Auto-encoding variational Bayes
Fast second order stochastic backpropagation for variational inference
Fan, K., Wang, Z., Beck, J., Kwok, J., and Heller, K. A. (2015) · 2015
Later among the works it cites.
Stochastic gradient variational Bayes for gamma approximating distributions
Knowles, D. A. (2015) · 2015
Later among the works it cites.
Automatic variational inference in Stan
Kucukelbir, A., Ranganath, R., Gelman, A., and Blei, D. M. (2015) · 2015
Later among the works it cites.
Human-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., and Tenenbaum, J. B. (2015) · 2015
Later among the works it cites.
Deep exponential families
Ranganath, R., Tang, L., Charlin, L., and Blei, D. M. (2015) · 2015
Later among the works it cites.
Gradient estimation using stochastic computation graphs
Schulman, J., Heess, N., Weber, T., and Abbeel, P. (2015) · 2015
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Kingma, D. P. and Welling, M. (2014) · 2014
Cited alongside, same era.
Neural variational inference and learning in belief networks
Mnih, A. and Gregor, K. (2014) · 2014
Cited alongside, same era.
Black box variational inference
Ranganath, R., Gerrish, S., and Blei, D. M. (2014) · 2014
Cited alongside, same era.
Stochastic backpropagation and approximate inference in deep generative models
Rezende, D. J., Mohamed, S., and Wierstra, D. (2014) · 2014
Cited alongside, same era.
Doubly stochastic variational Bayes for non-conjugate inference
Titsias, M. K. and Lázaro-Gredilla, M. (2014) · 2014
Cited alongside, same era.
Automatic differentiation in machine learning: a survey
Baydin, A. G., Pearlmutter, B. A., and Radul, A. A. (2015) · 2015
Cited alongside, same era.
Later among the works it cites.
Local expectation gradients for black box variational inference
Titsias, M. K. and Lázaro-Gredilla, M. (2015) · 2015
Later among the works it cites.
MuProp: Unbiased backpropagation for stochastic neural networks
Gu, S., Levine, S., Sutskever, I., and Mnih, A. (2016) · 2016
Closest in time.
Automatic differentiation variational inference
Kucukelbir, A., Tran, D., Ranganath, R., Gelman, A., and Blei, D. M. (2016) · 2016
Closest in time.
Overdispersed black-box variational inference
Ruiz, F. J. R., Titsias, M. K., and Blei, D. M. (2016) · 2016
Closest in time.
Black-box policy search with probabilistic programs
van de Meent, J.-W., Tolpin, D., Paige, B., and Wood, F. (2016) · 2016
Closest in time.