Fetching the paper…
Reading the bibliography…
We show that a large class of Estimation of Distribution Algorithms, including, but not limited to, Covariance Matrix Adaption, can be written as a Monte Carlo Expectation-Maximization algorithm, and as exact EM in the limit of infinite samples.
Maximum likelihood from incomplete data via the EM algorithm
A. P. Dempster, N. M. Laird, and D. B. Rubin. 1977 · 1977
Earlier work this paper cites.
Spin glasses and the statistical mechanics of protein folding
J D Bryngelson and P G Wolynes. 1987 · 1987
Earlier work this paper cites.
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Ronald J. Williams. 1992 · 1992
Earlier work this paper cites.
Variational Algorithms for Approximate Bayesian Inference
Matthew J Beal. 1998 · 1998
Earlier work this paper cites.
Acceleration of the EM algorithm via proximal point iterations. In Proceedings of the IEEE International Symposium on Information Theory (ISIT)
Stephane Chrétien and Alfred O Hero III. 1998 · 1998
Earlier work this paper cites.
Learning in Graphical Models
Radford M. Neal and Geoffrey E. Hinton. 1999 · 1999
Earlier work this paper cites.
The Cross-Entropy Method for Combinatorial and Continuous Optimization
Reuven Rubinstein and William Davidson. 1999 · 1999
Earlier work this paper cites.
Kullback proximal algorithms for maximum-likelihood estimation
Stéphane Chrétien and Alfred O. III Hero. 2000 · 2000
Earlier work this paper cites.
Probability and random processes
G.R. Grimmett and D.R. Stirzaker. 2001 · 2001
Earlier work this paper cites.
Completely Derandomized Self-Adaptation in Evolution Strategies
Nikolaus Hansen and Andreas Ostermeier. 2001 · 2001
Earlier work this paper cites.
Unsupervised Learning by Probabilistic Latent Semantic Analysis
Thomas Hofmann. 2001 · 2001
Earlier work this paper cites.
Online Model Selection Based on the Variational Bayes
Masa-Aki Sato. 2001 · 2001
Earlier work this paper cites.
Mirror descent and nonlinear projected subgradient methods for convex optimization
Amir Beck and Marc Teboulle. 2003 · 2003
Earlier work this paper cites.
Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES)
Nikolaus Hansen, Sibylle D. Müller, and Petros Koumoutsakos. 2003 · 2003
Earlier work this paper cites.
Information theory, inference, and learning algorithms
David J. C. MacKay. 2003 · 2003
Cited alongside, same era.
Optimization with EM and Expectation-Conjugate-Gradient. In Proceedings, Intl. Conf. on Machine Learning (ICML)
Ruslan Salakhutdinov, Sam Roweis, and Zoubin Ghahramani. 2003 · 2003
Cited alongside, same era.
Learning probability distributions in continuous evolutionary algorithms – a comparative review
Stefan Kern, Sibylle D. Müller, Nikolaus Hansen, Dirk Büche, Jiri Ocenasek, and Petros Koumoutsakos. 2004 · 2004
Cited alongside, same era.
Model-based search for combinatorial optimization: A critical survey
Mark Zlochin, Mauro Birattari, Nicolas Meuleau, and Marco Dorigo. 2004 · 2004
Cited alongside, same era.
Reinforcement Learning by Reward-weighted Regression for Operational Space Control. In Proceedings of the 24th International Conference on Machine Learning
Jan Peters and Stefan Schaal. 2007 · 2007
Cited alongside, same era.
Stochastic Variational Inference
Matthew D. Hoffman, David M. Blei, Chong Wang, and John Paisley. 2013 · 2013
Later among the works it cites.
Natural gradient, fitness modelling and model selection: A unifying perspective. In IEEE Congress on Evolutionary Computation
L. Malagò, M. Matteucci, and G. Pistone. 2013 · 2013
Later among the works it cites.
Multi-Objective Optimization with Estimation of Distribution Algorithm in a Noisy Environment
V. A. Shim, K. C. Tan, J. Y. Chia, and A. Al Mamun. 2013 · 2013
Later among the works it cites.
Optimization by Variational Bounding. In European Symposium on ANNs
J Staines and D Barber. 2013 · 2013
Later among the works it cites.
New insights and perspectives on the natural gradient method
James Martens. 2014 · 2014
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Optimization by estimation of distribution with DEUM framework based on Markov random fields
Siddhartha Shakya and John McCall. 2007 · 2007
Cited alongside, same era.
Natural Evolution Strategies. In 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence)
D. Wierstra, T. Schaul, J. Peters, and J. Schmidhuber. 2008 · 2008
Cited alongside, same era.
Stochastic Search Using the Natural Gradient. In Proceedings of the 26th Annual International Conference on Machine Learning
Sun Yi, Daan Wierstra, Tom Schaul, and Jürgen Schmidhuber. 2009 · 2009
Cited alongside, same era.
Bidirectional Relation between CMA Evolution Strategies and Natural Evolution Strategies. In Parallel Problem Solving from Nature, PPSN XI
Youhei Akimoto, Yuichi Nagata, Isao Ono, and Shigenobu Kobayashi. 2010 · 2010
Cited alongside, same era.
Annealing adaptive search, cross-entropy, and stochastic approximation in global optimization
Jiaqiao Hu and Ping Hu. 2011 · 2011
Cited alongside, same era.
Protein 3D Structure Computed from Evolutionary Sequence Variation
Debora S. Marks, Lucy J. Colwell, Robert Sheridan, Thomas A. Hopf, Andrea Pagnani, Riccardo Zecchina, and Chris Sander. 2011 · 2011
Cited alongside, same era.
Theoretical foundation for CMA-ES from information geometry perspective
Youhei Akimoto, Yuichi Nagata, Isao Ono, and Shigenobu Kobayashi. 2012 · 2012
Cited alongside, same era.
Daan Wierstra, Tom Schaul, Tobias Glasmachers, Yi Sun, Jan Peters, and Jürgen Schmidhuber. 2014 · 2014
Later among the works it cites.
The information geometry of mirror descent
Garvesh Raskutti and Sayan Mukherjee. 2015 · 2015
Later among the works it cites.
Variational Tempering. In AISTATS
Stephan Mandt, James McInerney, Farhan Abrol, Rajesh Ranganath, and David M. Blei. 2016 · 2016
Later among the works it cites.
Statistical guarantees for the EM algorithm: From population to sample-based analysis
Sivaraman Balakrishnan, Martin J. Wainwright, and Bin Yu. 2017 · 2017
Later among the works it cites.
Information-geometric Optimization Algorithms: A Unifying Picture via Invariance Principles
Yann Ollivier, Ludovic Arnold, Anne Auger, and Nikolaus Hansen. 2017 · 2017
Later among the works it cites.
A Tour of Reinforcement Learning: The View from Continuous Control
Benjamin Recht. 2018 · 2018
Later among the works it cites.
Natural Gradients in Practice: Non-Conjugate Variational Inference in Gaussian Process Models. In Uncertainty In Artificial Intelligence
Hugh Salimbeni, Stefanos Eleftheriadis, and James Hensman. 2018 · 2018
Later among the works it cites.
Conditioning by adaptive sampling for robust design. In Proceedings of the 36th International Conference on Machine Learning
David Brookes, Hahnbeom Park, and Jennifer Listgarten. 2019 · 2019
Closest in time.