2019

pySOT and POAP: An event-driven asynchronous framework for surrogate optimization

Eriksson, David, Bindel, David, Shoemaker, Christine A.

Understand

This paper describes Plumbing for Optimization with Asynchronous Parallelism (POAP) and the Python Surrogate Optimization Toolbox (pySOT).

POAP is an event-driven framework for building and combining asynchronous optimization strategies, designed for global optimization of expensive functions where concurrent function evaluations are useful.
POAP consists of three components: a worker pool capable of function evaluations, strategies to propose evaluations or other actions, and a controller that mediates the interaction between the workers and strategies.
pySOT is a collection of synchronous and asynchronous surrogate optimization strategies, implemented in the POAP framework.

Built on

“direct search”solution of numerical and statistical problems
Robert Hooke and Terry A Jeeves · 1961
Earlier work this paper cites.
A simplex method for function minimization
John A Nelder and Roger Mead · 1965
Earlier work this paper cites.
Multivariate adaptive regression splines
Jerome H Friedman · 1991
Earlier work this paper cites.
Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces
Rainer Storn and Kenneth Price · 1997
Earlier work this paper cites.
Efficient global optimization of expensive black-box functions
Donald R Jones, Matthias Schonlau, and William J Welch · 1998
Earlier work this paper cites.
A radial basis function method for global optimization
H-M Gutmann · 2001
Earlier work this paper cites.
A taxonomy of global optimization methods based on response surfaces
Donald R Jones · 2001
Earlier work this paper cites.
Nonlinear programming: analysis and methods
Mordecai Avriel · 2003
Earlier work this paper cites.
Radial basis functions: theory and implementations , volume 12
Martin D Buhmann · 2003
Earlier work this paper cites.
Scattered data approximation , volume 17
Holger Wendland · 2004
Earlier work this paper cites.
Genetic algorithms
David E Goldberg · 2006
Earlier work this paper cites.
Kernel techniques: from machine learning to meshless methods
Robert Schaback and Holger Wendland · 2006
Earlier work this paper cites.
Gaussian process for machine learning
Carl Edward Rasmussen and Christopher KI Williams · 2006
Earlier work this paper cites.
A stochastic radial basis function method for the global optimization of expensive functions
Rommel G Regis and Christine A Shoemaker · 2007
Earlier work this paper cites.

Similar

DAKOTA, a multilevel parallel object-oriented framework for design optimization, parameter estimation, uncertainty quantification, and sensitivity analysis: Version 4.1 reference manual
Michael S Eldred, Anthony A Giunta, Bart G van Bloemen Waanders, Steven F Wojtkiewicz, William E Hart, and Mario P Alleva · 2007
Cited alongside, same era.
Meshfree Approximation Methods with Matlab:(With CD-ROM) , volume 6
Gregory E Fasshauer · 2007
Cited alongside, same era.
A knowledge-gradient policy for sequential information collection
Peter I Frazier, Warren B Powell, and Savas Dayanik · 2008
Cited alongside, same era.
Efficient global reliability analysis for nonlinear implicit performance functions
Barron J Bichon, Michael S Eldred, Laura Painton Swiler, Sandaran Mahadevan, and John M McFarland · 2008
Cited alongside, same era.
Parallel stochastic global optimization using radial basis functions
Rommel G Regis and Christine A Shoemaker · 2009
Cited alongside, same era.
Hopspack 2.0 user manual
Todd D Plantenga · 2009
Cited alongside, same era.
Real-parameter black-box optimization benchmarking 2009: Noiseless functions definitions
Nikolaus Hansen, Steffen Finck, Raymond Ros, and Anne Auger · 2009
Cited alongside, same era.
Particle swarm optimization
James Kennedy · 2010
Cited alongside, same era.
A tutorial on bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning
Original
Eric Brochu, Vlad M Cora, and Nando De Freitas · 2010
Cited alongside, same era.
Global convergence of radial basis function trust region derivative-free algorithms
Stefan M Wild and Christine Shoemaker · 2011
Cited alongside, same era.
Algorithm 909: Nomad: Nonlinear optimization with the mads algorithm
Sébastien Le Digabel · 2011
Cited alongside, same era.
Mixture surrogate models based on dempster-shafer theory for global optimization problems
Juliane Müller and Robert Piché · 2011
Cited alongside, same era.

Then

Practical Bayesian optimization of machine learning algorithms
Jasper Snoek, Hugo Larochelle, and Ryan P Adams · 2012
Later among the works it cites.
Combining radial basis function surrogates and dynamic coordinate search in high-dimensional expensive black-box optimization
Rommel G Regis and Christine A Shoemaker · 2013
Later among the works it cites.
So-mi: A surrogate model algorithm for computationally expensive nonlinear mixed-integer black-box global optimization problems
Juliane Müller, Christine A Shoemaker, and Robert Piché · 2013
Later among the works it cites.
Influence of ensemble surrogate models and sampling strategy on the solution quality of algorithms for computationally expensive black-box global optimization problems
Juliane Müller and Christine A Shoemaker · 2014
Later among the works it cites.
Once you scoop, no need to fork
Yannick Hold-Geoffroy, Olivier Gagnon, and Marc Parizeau · 2014
Later among the works it cites.
Matsumoto: The matlab surrogate model toolbox for computationally expensive black-box global optimization problems
Original
Juliane Mueller · 2014
Later among the works it cites.
Bayesopt: A bayesian optimization library for nonlinear optimization, experimental design and bandits
Ruben Martinez-Cantin · 2014
Later among the works it cites.
Rbfopt: an open-source library for black-box optimization with costly function evaluations
Alberto Costa and Giacomo Nannicini · 2014
Later among the works it cites.
Kernel interpolation for scalable structured gaussian processes (kiss-gp)
Andrew Wilson and Hannes Nickisch · 2015
Later among the works it cites.
Sop: parallel surrogate global optimization with pareto center selection for computationally expensive single objective problems
Tipaluck Krityakierne, Taimoor Akhtar, and Christine A Shoemaker · 2016
Later among the works it cites.
The parallel knowledge gradient method for batch bayesian optimization
Jian Wu and Peter Frazier · 2016
Later among the works it cites.
Bayesian optimization with gradients
Jian Wu, Matthias Poloczek, Andrew G Wilson, and Peter Frazier · 2017
Later among the works it cites.
Scalable log determinants for gaussian process kernel learning
Kun Dong, David Eriksson, Hannes Nickisch, David Bindel, and Andrew G Wilson · 2017
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…