Stochastic Variational Optimization

A New Monte Carlo Technique: Antithetic Variates

Hammersley, J. M. and Morton, K. W · 1956

Earlier work this paper cites.

Antithetic Variates Revisited

Fishman, G. S. and Huang, B. D · 1983

Earlier work this paper cites.

Multivariate stochastic approximation using a simultaneous perturbation gradient approximation

J. C. Spall · 1992

Earlier work this paper cites.

Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning

R. J. Williams · 1992

Earlier work this paper cites.

Variance Reduction Techniques for Gradient Estimates in Reinforcement Learning

Greensmith, E., Bartlett, P. L., and Baxter, J · 2004

Earlier work this paper cites.

Natural Evolution Strategies

D. Wierstra, T. Schaul, J. Peters, and J. Schmidhuber · 2008

Cited alongside, same era.

Parallelized Stochastic Gradient Descent

Zinkevich, M. A., Weimer, M., Smola, A., and Li, L · 2010

Cited alongside, same era.

Large Scale Distributed Deep Networks

Dean, J., Corrado, G. S., Monga, R., Chen, K., Devin, M., Le, Q. V., Mao, M. Z., Ranzato, M., Senior, A., Tucker, P., Yang, K., and Ng, A. Y · 2012

Cited alongside, same era.

Variational Optimization

Original

J. Staines and D. Barber · 2012

Cited alongside, same era.

Optimization by Variational Bounding

J. Staines and D. Barber · 2013

Cited alongside, same era.

Adam: A Method for Stochastic Optimization

Original

Kingma D. P. and Ba J · 2014

Later among the works it cites.

Natural Evolution Strategies

Wierstra, D., Schaul, T., Glasmachers, T., Sun, Y, Peters, J., and Schmidhuber, J · 2014

Later among the works it cites.

Automatic Differentiation in Machine Learning: a Survey

Original

Baydin A. G., Pearlmutter, B. A., and Radul, A. A · 2015

Later among the works it cites.

Evolution Strategies as a Scalable Alternative to Reinforcement Learning

Original

T. Salimans, J. Ho, X. Chen, and I. Sutskever · 2017

Later among the works it cites.