Fetching the paper…
Reading the bibliography…
Training models with discrete latent variables is challenging due to the high variance of unbiased gradient estimators.
Likelihood ratio gradient estimation for stochastic systems
Glynn, P. W. (1990) · 1990
Earlier work this paper cites.
Optimization of static simulation models by the score function method
Rubinstein, R. Y. and Shapiro, A. (1990) · 1990
Earlier work this paper cites.
Simple statistical gradient-following algorithms for connectionist reinforcement learning
Williams, R. J. (1992) · 1992
Earlier work this paper cites.
An introduction to variational methods for graphical models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., and Saul, L. K. (1999) · 1999
Earlier work this paper cites.
Estimating gradients for discrete random variables by sampling without replacement
Kool, W., van Hoof, H., and Welling, M. (2020) · 2002
Earlier work this paper cites.
DisARM: An antithetic gradient estimator for binary latent variables
Dong, Z., Mnih, A., and Tucker, G. (2020) · 2006
Earlier work this paper cites.
Tree-structured stick breaking for hierarchical data
Ghahramani, Z., Jordan, M., and Adams, R. P. (2010) · 2010
Earlier work this paper cites.
MNIST handwritten digit database
LeCun, Y., Cortes, C., and Burges, C. (2010) · 2010
Earlier work this paper cites.
Rao-Blackwellizing the straight-through Gumbel-softmax gradient estimator
Paulus, M. B., Maddison, C. J., and Krause, A. (2020) · 2010
Earlier work this paper cites.
VarGrad: a low-variance gradient estimator for variational inference
Richter, L., Boustati, A., Nüsken, N., Ruiz, F. J., and Akyildiz, Ö. D. (2020) · 2010
Earlier work this paper cites.
A stick-breaking likelihood for categorical data analysis with latent gaussian models
Khan, M., Mohamed, S., Marlin, B., and Murphy, K. (2012) · 2012
Earlier work this paper cites.
Monte Carlo Methods in Financial Engineering
Glasserman, P. (2013) · 2013
Earlier work this paper cites.
Monte Carlo theory, methods and examples
Owen, A. B. (2013) · 2013
Earlier work this paper cites.
Auto-encoding variational Bayes
Kingma, D. P. and Welling, M. (2014) · 2014
Cited alongside, same era.
Neural variational inference and learning in belief networks
Mnih, A. and Gregor, K. (2014) · 2014
Cited alongside, same era.
Black box variational inference
Ranganath, R., Gerrish, S., and Blei, D. M. (2014) · 2014
Cited alongside, same era.
Stochastic backpropagation and approximate inference in deep generative models
Rezende, D. J., Mohamed, S., and Wierstra, D. (2014) · 2014
Cited alongside, same era.
Reweighted wake-sleep
Bornschein, J. and Bengio, Y. (2015) · 2015
Cited alongside, same era.
Human-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., and Tenenbaum, J. B. (2015) · 2015
Cited alongside, same era.
REBAR: Low-variance, unbiased gradient estimates for discrete latent variable models
Tucker, G., Mnih, A., Maddison, C. J., Lawson, J., and Sohl-Dickstein, J. (2017) · 2017
Later among the works it cites.
Fashion-MNIST: a novel image dataset for benchmarking machine learning algorithms
Xiao, H., Rasul, K., and Vollgraf, R. (2017) · 2017
Later among the works it cites.
Backpropagation through the void: Optimizing control variates for black-box gradient estimation
Grathwohl, W., Choi, D., Wu, Y., Roeder, G., and Duvenaud, D. (2018) · 2018
Later among the works it cites.
Buy 4 REINFORCE samples, get a baseline for free!
Kool, W., van Hoof, H., and Welling, M. (2019) · 2019
Later among the works it cites.
Rao-Blackwellized stochastic gradients for discrete distributions
Liu, R., Regier, J., Tripuraneni, N., Jordan, M., and Mcauliffe, J. (2019) · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Local expectation gradients for black box variational inference
Titsias, M. K. and Lázaro-Gredilla, M. (2015) · 2015
Cited alongside, same era.
Empirical evaluation of rectified activations in convolutional network
Xu, B., Wang, N., Chen, T., and Li, M. (2015) · 2015
Cited alongside, same era.
Stick-breaking variational autoencoders
Nalisnick, E. and Smyth, P. (2016) · 2016
Cited alongside, same era.
Overdispersed black-box variational inference
Ruiz, F. J., Titsias, M. K., and Blei, D. M. (2016) · 2016
Cited alongside, same era.
Categorical reparameterization with Gumbel-softmax
Jang, E., Gu, S., and Poole, B. (2017) · 2017
Cited alongside, same era.
The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
Maddison, C. J., Mnih, A., and Teh, Y. W. (2017) · 2017
Cited alongside, same era.
ARSM: Augment-REINFORCE-swap-merge estimator for gradient backpropagation through categorical variables
Yin, M., Yue, Y., and Zhou, M. (2019) · 2019
Later among the works it cites.
ARM: Augment-REINFORCE-merge gradient for stochastic binary networks
Yin, M. and Zhou, M. (2019) · 2019
Later among the works it cites.
Joint stochastic approximation and its application to learning discrete latent variable models
Ou, Z. and Song, Y. (2020) · 2020
Later among the works it cites.
Probabilistic Best Subset Selection by Gradient-Based Optimization
Yin, M., Ho, N., Yan, B., Qian, X., and Zhou, M. (2020) · 2020
Later among the works it cites.
On the dangers of stochastic parrots: Can language models be too big?
Bender, E. M., Gebru, T., McMillan-Major, A., and Shmitchell, S. (2021) · 2021
Closest in time.
ARMS: Antithetic-REINFORCE-multi-sample gradient for binary variables
Dimitriev, A. and Zhou, M. (2021) · 2021
Closest in time.
Carbon emissions and large neural network training
Patterson, D., Gonzalez, J., Le, Q., Liang, C., Munguia, L.-M., Rothchild, D., So, D., Texier, M., and Dean, J. (2021) · 2021
Closest in time.