Fetching the paper…
Reading the bibliography…
Hyperparameter optimization (HPO) is crucial for strong performance of deep learning algorithms and real-world applications often impose some constraints, such as on memory usage or latency, on top of the performance requirement.
A new method of locating the maximum point of an arbitrary multipeak curve in the presence of noise
HJ. Kushner · 1964
Earlier work this paper cites.
Multivariate binary discrimination by the kernel method
J. Aitchison and CG. Aitken · 1976
Earlier work this paper cites.
Efficient global optimization of expensive black-box functions
D. Jones, M. Schonlau, and W. Welch · 1998
Earlier work this paper cites.
A fast and elitist multiobjective genetic algorithm: NSGA-II
K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan · 2002
Earlier work this paper cites.
Modified differential evolution for constrained optimization
EM. Montes, J. Velázquez-Reyes, and CA. Coello · 2006
Earlier work this paper cites.
E. Brochu, V. Cora, and N. de Freitas · 2010
Earlier work this paper cites.
Algorithms for hyper-parameter optimization
J. Bergstra, R. Bardenet, Y. Bengio, and B. Kégl · 2011
Earlier work this paper cites.
Algorithms for hyper-parameter optimization
J. Bergstra, R. Bardenet, Y. Bengio, and B. Kégl · 2011
Earlier work this paper cites.
A (1+1)-CMA-ES for constrained optimisation
D. Arnold and N. Hansen · 2012
Earlier work this paper cites.
Random search for hyper-parameter optimization
J. Bergstra and Y. Bengio · 2012
Earlier work this paper cites.
Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures
J. Bergstra, D. Yamins, and D. Cox · 2013
Earlier work this paper cites.
Bi-population CMA-ES agorithms with surrogate models and line searches
I. Loshchilov, M. Schoenauer, and M. Sebag · 2013
Earlier work this paper cites.
Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures
J. Bergstra, D. Yamins, and D. Cox · 2013
Earlier work this paper cites.
Towards an empirical foundation for assessing Bayesian optimization of hyperparameters
K. Eggensperger, M. Feurer, F. Hutter, J. Bergstra, J. Snoek, H. Hoos, and K. Leyton-Brown · 2013
Earlier work this paper cites.
Bayesian optimization with inequality constraints
J. Gardner, M. Kusner, ZE. Xu, K. Weinberger, and J. Cunningham · 2014
Earlier work this paper cites.
Bayesian optimization with unknown constraints
M. Gelbart, J. Snoek, and R. Adams · 2014
Earlier work this paper cites.
Predictive entropy search for bayesian optimization with unknown constraints
JH. Lobato, M. Gelbart, M. Hoffman, R. Adams, and Z. Ghahramani · 2015
Cited alongside, same era.
CMA-ES for hyperparameter optimization of deep neural networks
I. Loshchilov and F. Hutter · 2016
Cited alongside, same era.
Taking the human out of the loop: A review of Bayesian optimization
B. Shahriari, K. Swersky, Z. Wang, R. Adams, and N. de Freitas · 2016
Cited alongside, same era.
Bayesian optimization in alphago
Y. Chen, A. Huang, Z. Wang, I. Antonoglou, J. Schrittwieser, D. Silver, and N. de Freitas · 2018
Cited alongside, same era.
BOHB: Robust and efficient hyperparameter optimization at scale
S. Falkner, A. Klein, and F. Hutter · 2018
Cited alongside, same era.
Mixed-variable Bayesian optimization
E. Daxberger, A. Makarova, M. Turchetta, and A. Krause · 2019
Later among the works it cites.
Scalable global optimization via local Bayesian optimization
D. Eriksson, M. Pearce, J. Gardner, RD. Turner, and M. Poloczek · 2019
Later among the works it cites.
NAS-Bench-201: Extending the scope of reproducible neural architecture search
X. Dong and Y. Yang · 2020
Later among the works it cites.
Bayesian optimisation over multiple continuous and categorical inputs
B. Ru, A. Alvi, Vu V. Nguyen, M. Osborne, and S. Roberts · 2020
Later among the works it cites.
DEHB: Evolutionary hyberband for scalable, robust and efficient hyperparameter optimization
N. Awad, N. Mallik, and F. Hutter · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
R. Liaw, E. Liang, R. Nishihara, P. Moritz, J. Gonzalez, and I. Stoica · 2018
Cited alongside, same era.
On the state of the art of evaluation in neural language models
G. Melis, C. Dyer, and P. Blunsom · 2018
Cited alongside, same era.
BOHB: Robust and efficient hyperparameter optimization at scale
S. Falkner, A. Klein, and F. Hutter · 2018
Cited alongside, same era.
Optuna: A next-generation hyperparameter optimization framework
T. Akiba, S. Sano, T. Yanase, T. Ohta, and M. Koyama · 2019
Cited alongside, same era.
Open images 2019 - object detection, 2019
JE. Alina, C. Phil, B. Rodrigo, and G. Victor · 2019
Cited alongside, same era.
Tabular benchmarks for joint architecture and hyperparameter optimization
A. Klein and F. Hutter · 2019
Cited alongside, same era.
Constrained Bayesian optimization with noisy experiments
B. Letham, B. Karrer, G. Ottoni, and E. Bakshy · 2019
Cited alongside, same era.
Scalable constrained Bayesian optimization
D. Eriksson and M. Poloczek · 2021
Later among the works it cites.
Bayesian optimization over hybrid spaces
A. Deshwal, S. Belakaria, and J. Doppa · 2021
Later among the works it cites.
SMAC3: A versatile Bayesian optimization package for hyperparameter optimization
M. Lindauer, K. Eggensperger, M. Feurer, A. Biedenkapp, D. Deng, C. Benjamins, R. Sass, and F. Hutter · 2021
Later among the works it cites.
Bayesian optimization is superior to random search for machine learning hyperparameter tuning: Analysis of the black-box optimization challenge 2020
R. Turner, D. Eriksson, M. McCourt, J. Kiili, E. Laaksonen, Z. Xu, and I. Guyon · 2021
Later among the works it cites.
Happywhale - whale and dolphin identification, 2022
H. Addison, KS. inversion, H. Ryan, and C. Ted · 2022
Closest in time.
Bayesian Optimization
R. Garnett · 2022
Closest in time.
Parallel predictive entropy search for multi-objective Bayesian optimization with constraints applied to the tuning of machine learning algorithms
EC. Garrido-Merchán, D. Fernández-Sánchez, and D. Hernández-Lobato · 2023
Closest in time.
S. Watanabe · 2023
Closest in time.
S. Watanabe · 2023
Closest in time.
OptunaHub: A platform for black-box optimization
Yoshihiko Ozaki, Shuhei Watanabe, and Toshihiko Yanase · 2025
Closest in time.