Fetching the paper…
Reading the bibliography…
A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization.
On the likelihood that one unknown probability exceeds another in view of the evidence of two samples
William R Thompson. 1933 · 1933
Earlier work this paper cites.
A new measure of rank correlation
Maurice G Kendall. 1938 · 1938
Earlier work this paper cites.
Auto-keras: An efficient neural architecture search system. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining . 1946–1956
Haifeng Jin, Qingquan Song, and Xia Hu. 2019 · 1956
Earlier work this paper cites.
A new method of locating the maximum point of an arbitrary multipeak curve in the presence of noise
Harold J Kushner. 1964 · 1964
Earlier work this paper cites.
A simplex method for function minimization
John A Nelder and Roger Mead. 1965 · 1965
Earlier work this paper cites.
On Bayesian methods for seeking the extremum. In Optimization techniques IFIP technical conference . Springer, 400–404
Jonas Močkus. 1975 · 1975
Earlier work this paper cites.
The application of Bayesian methods for seeking the extremum
Jonas Mockus, Vytautas Tiesis, and Antanas Zilinskas. 1978 · 1978
Earlier work this paper cites.
Efficient global optimization of expensive black-box functions
Donald R Jones, Matthias Schonlau, and William J Welch. 1998 · 1998
Earlier work this paper cites.
Policy gradient methods for reinforcement learning with function approximation
Richard S Sutton, David McAllester, Satinder Singh, and Yishay Mansour. 1999 · 1999
Earlier work this paper cites.
Random forests
Leo Breiman. 2001 · 2001
Earlier work this paper cites.
A taxonomy of global optimization methods based on response surfaces
Donald R Jones. 2001 · 2001
Earlier work this paper cites.
Sparse Bayesian learning and the relevance vector machine
Michael E Tipping. 2001 · 2001
Earlier work this paper cites.
Optimizing search engines using clickthrough data. In Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining . 133–142
Thorsten Joachims. 2002 · 2002
Earlier work this paper cites.
Gaussian processes in machine learning. In Summer school on machine learning . Springer, 63–71
Carl Edward Rasmussen. 2003 · 2003
Earlier work this paper cites.
Standard handbook of machine design
Joseph E Shigley, Charles R Mischke, and Thomas Hunter Brown Jr. 2004 · 2004
Earlier work this paper cites.
Preference learning with Gaussian processes. In Proceedings of the 22nd international conference on Machine learning . 137–144
Wei Chu and Zoubin Ghahramani. 2005 · 2005
Earlier work this paper cites.
A textbook of machine design
RS Khurmi and JK Gupta. 2005 · 2005
Earlier work this paper cites.
Pattern recognition and machine learning . Vol. 4
Christopher M Bishop and Nasser M Nasrabadi. 2006 · 2006
Earlier work this paper cites.
Gaussian processes for machine learning . Vol. 2
Christopher K Williams and Carl Edward Rasmussen. 2006 · 2006
Earlier work this paper cites.
The hadoop distributed file system: Architecture and design
Dhruba Borthakur. 2007 · 2007
Earlier work this paper cites.
Automatic Gait Optimization With Gaussian Process Regression.. In IJCAI , Vol. 7. 944–949
Daniel J Lizotte, Tao Wang, Michael H Bowling, Dale Schuurmans, et al · 2007
Earlier work this paper cites.
Active policy learning for robot planning and exploration under uncertainty.. In Robotics: Science and systems , Vol. 3. 321–328
Ruben Martinez-Cantin, Nando de Freitas, Arnaud Doucet, and José A Castellanos. 2007 · 2007
Earlier work this paper cites.
A new view of automatic relevance determination
David Wipf and Srikantan Nagarajan. 2007 · 2007
Earlier work this paper cites.
Sensorscope: Out-of-the-box environmental monitoring. In 2008 International Conference on Information Processing in Sensor Networks (ipsn 2008) . IEEE, 332–343
Guillermo Barrenetxea, François Ingelrest, Gunnar Schaefer, Martin Vetterli, Olivier Couach, and Marc Parlange. 2008 · 2008
Earlier work this paper cites.
Exact matrix completion via convex optimization
Emmanuel J Candès and Benjamin Recht. 2009 · 2009
Earlier work this paper cites.
Introduction to derivative-free optimization
Andrew R Conn, Katya Scheinberg, and Luis N Vicente. 2009 · 2009
Earlier work this paper cites.
The knowledge-gradient policy for correlated normal beliefs
Peter Frazier, Warren Powell, and Savas Dayanik. 2009 · 2009
Earlier work this paper cites.
Gaussian process optimization in the bandit setting: No regret and experimental design
Niranjan Srinivas, Andreas Krause, Sham M Kakade, and Matthias Seeger. 2009 · 2009
Earlier work this paper cites.
A Bayesian interactive optimization approach to procedural animation design. In Proceedings of the 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation . 103–112
Eric Brochu, Tyson Brochu, and Nando De Freitas. 2010a · 2010
Earlier work this paper cites.
Eric Brochu, Vlad M Cora, and Nando De Freitas. 2010b · 2010
Earlier work this paper cites.
Copula processes
Andrew G Wilson and Zoubin Ghahramani. 2010 · 2010
Earlier work this paper cites.
Spark: Cluster computing with working sets
Matei Zaharia, Mosharaf Chowdhury, Michael J Franklin, Scott Shenker, Ion Stoica, et al · 2010
Earlier work this paper cites.
Algorithms for hyper-parameter optimization
James Bergstra, Rémi Bardenet, Yoshua Bengio, and Balázs Kégl. 2011 · 2011
Earlier work this paper cites.
Sequential model-based optimization for general algorithm configuration. In International conference on learning and intelligent optimization . Springer, 507–523
Frank Hutter, Holger H Hoos, and Kevin Leyton-Brown. 2011 · 2011
Earlier work this paper cites.
Combinatorial optimization . Vol. 1
Bernhard H Korte, Jens Vygen, B Korte, and J Vygen. 2011 · 2011
Earlier work this paper cites.
Entropy Search for Information-Efficient Global Optimization
Philipp Hennig and Christian J Schuler. 2012 · 2012
Earlier work this paper cites.
Grey-box approach for performance prediction in map-reduce based platforms. In 2012 21st International Conference on Computer Communications and Networks (ICCCN) . IEEE, 1–9
Selvi Kadirvel and José AB Fortes. 2012 · 2012
Earlier work this paper cites.
Bayesian optimisation for intelligent environmental monitoring. In 2012 IEEE/RSJ international conference on intelligent robots and systems . IEEE, 2242–2249
Roman Marchant and Fabio Ramos. 2012 · 2012
Earlier work this paper cites.
Practical bayesian optimization of machine learning algorithms. In Advances in neural information processing systems
Jasper Snoek, Hugo Larochelle, and Ryan P Adams. 2012 · 2012
Earlier work this paper cites.
Collaborative hyperparameter tuning. In International conference on machine learning . PMLR, 199–207
Rémi Bardenet, Mátyás Brendel, Balázs Kégl, and Michele Sebag. 2013 · 2013
Earlier work this paper cites.
Kernel embeddings of conditional distributions: A unified kernel framework for nonparametric inference in graphical models
Le Song, Kenji Fukumizu, and Arthur Gretton. 2013 · 2013
Earlier work this paper cites.
Multi-task bayesian optimization
Kevin Swersky, Jasper Snoek, and Ryan P Adams. 2013 · 2013
Earlier work this paper cites.
Stochastic gradient hamiltonian monte carlo. In International conference on machine learning . PMLR, 1683–1691
Tianqi Chen, Emily Fox, and Carlos Guestrin. 2014 · 2014
Cited alongside, same era.
Bayesian optimization with inequality constraints.. In ICML , Vol. 2014. 937–945
Jacob R Gardner, Matt J Kusner, Zhixiang Eddie Xu, Kilian Q Weinberger, and John P Cunningham. 2014 · 2014
Cited alongside, same era.
Predictive entropy search for efficient global optimization of black-box functions
José Miguel Hernández-Lobato, Matthew W Hoffman, and Zoubin Ghahramani. 2014 · 2014
Cited alongside, same era.
A review of population initialization techniques for evolutionary algorithms. In 2014 IEEE congress on evolutionary computation (CEC) . IEEE, 2585–2592
Borhan Kazimipour, Xiaodong Li, and A Kai Qin. 2014 · 2014
Cited alongside, same era.
Learning ordered representations with nested dropout. In International Conference on Machine Learning . PMLR, 1746–1754
Oren Rippel, Michael Gelbart, and Ryan Adams. 2014 · 2014
Bayesian optimization for accelerated drug discovery
Edward O Pyzer-Knapp. 2018 · 2018
Later among the works it cites.
Selecting optimal source for transfer learning in Bayesian optimisation. In Pacific Rim International Conference on Artificial Intelligence . Springer, 42–56
Anil Ramachandran, Sunil Gupta, Santu Rana, and Svetha Venkatesh. 2018 · 2018
Later among the works it cites.
Regret bounds for meta bayesian optimization with an unknown gaussian process prior
Zi Wang, Beomjoon Kim, and Leslie P Kaelbling. 2018 · 2018
Later among the works it cites.
Scalable gaussian process-based transfer surrogates for hyperparameter optimization
Martin Wistuba, Nicolas Schilling, and Lars Schmidt-Thieme. 2018 · 2018
Later among the works it cites.
Ant colony optimization: overview and recent advances
Marco Dorigo and Thomas Stützle. 2019 · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
An entropy search portfolio for Bayesian optimization
Bobak Shahriari, Ziyu Wang, Matthew W Hoffman, Alexandre Bouchard-Côté, and Nando de Freitas. 2014 · 2014
Cited alongside, same era.
Efficient transfer learning method for automatic hyperparameter tuning. In Artificial intelligence and statistics . PMLR, 1077–1085
Dani Yogatama and Gideon Mann. 2014 · 2014
Cited alongside, same era.
From black-box complexity to designing new genetic algorithms
Benjamin Doerr, Carola Doerr, and Franziska Ebel. 2015 · 2015
Cited alongside, same era.
Efficient and robust automated machine learning
Matthias Feurer, Aaron Klein, Katharina Eggensperger, Jost Springenberg, Manuel Blum, and Frank Hutter. 2015a · 2015
Cited alongside, same era.
Notes on mean embeddings and covariance operators
Arthur Gretton. 2015 · 2015
Cited alongside, same era.
Taking the human out of the loop: A review of Bayesian optimization
Bobak Shahriari, Kevin Swersky, Ziyu Wang, Ryan P Adams, and Nando De Freitas. 2015 · 2015
Cited alongside, same era.
Scalable bayesian optimization using deep neural networks. In International conference on machine learning . PMLR, 2171–2180
Jasper Snoek, Oren Rippel, Kevin Swersky, Ryan Kiros, Nadathur Satish, Narayanan Sundaram, Mostofa Patwary, Mr Prabhat, and Ryan Adams. 2015 · 2015
Cited alongside, same era.
A flexible transfer learning framework for Bayesian optimization with convergence guarantee
Tinu Theckel Joy, Santu Rana, Sunil Gupta, and Svetha Venkatesh. 2019 · 2019
Later among the works it cites.
Hyunjik Kim, Andriy Mnih, Jonathan Schwarz, Marta Garnelo, Ali Eslami, Dan Rosenbaum, Oriol Vinyals, and Yee Whye Teh. 2019 · 2019
Later among the works it cites.
Hyperparameter learning via distributional transfer
Ho Chung Law, Peilin Zhao, Leung Sing Chan, Junzhou Huang, and Dino Sejdinovic. 2019 · 2019
Later among the works it cites.
CAD tool design space exploration via Bayesian optimization. In 2019 ACM/IEEE 1st Workshop on Machine Learning for CAD (MLCAD) . IEEE, 1–6
Yuzhe Ma, Ziyang Yu, and Bei Yu. 2019 · 2019
Later among the works it cites.
Filtering Bayesian optimization approach in weakly specified search space
Vu Nguyen, Sunil Gupta, Santu Rana, Cheng Li, and Svetha Venkatesh. 2019 · 2019
Later among the works it cites.
Learning search spaces for bayesian optimization: Another view of hyperparameter transfer learning
Valerio Perrone, Huibin Shen, Matthias W Seeger, Cedric Archambeau, and Rodolphe Jenatton. 2019 · 2019
Later among the works it cites.
Meta-learning acquisition functions for transfer learning in bayesian optimization
Michael Volpp, Lukas P Fröhlich, Kirsten Fischer, Andreas Doerr, Stefan Falkner, Frank Hutter, and Christian Daniel. 2019 · 2019
Later among the works it cites.
Survey on automated machine learning
Marc-André Zöller and Marco F Huber. 2019 · 2019
Later among the works it cites.
Nas-bench-201: Extending the scope of reproducible neural architecture search
Xuanyi Dong and Yi Yang. 2020 · 2020
Later among the works it cites.
Autogluon-tabular: Robust and accurate automl for structured data
Nick Erickson, Jonas Mueller, Alexander Shirkov, Hang Zhang, Pedro Larroy, Mu Li, and Alexander Smola. 2020 · 2020
Later among the works it cites.
To Tune or Not to Tune?: In Search of Optimal Configurations for Data Analytics. In KDD . ACM, 2494–2504
Ayat Fekry, Lucian Carata, Thomas F. J.-M. Pasquier, Andrew Rice, and Andy Hopper. 2020 · 2020
Later among the works it cites.
Bayesian optimization for adaptive experimental design: a review
Stewart Greenhill, Santu Rana, Sunil Gupta, Pratibha Vellanki, and Svetha Venkatesh. 2020 · 2020
Later among the works it cites.
A survey on automatic parameter tuning for big data processing systems
Herodotos Herodotou, Yuxing Chen, and Jiaheng Lu. 2020 · 2020
Later among the works it cites.
Bayesian optimization objective-based experimental design. In 2020 American Control Conference (ACC) . IEEE, 3405–3411
Mahdi Imani and Seyede Fatemeh Ghoreishi. 2020 · 2020
Later among the works it cites.
Efficient automatic cash via rising bandits. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 34. 4763–4771
Yang Li, Jiawei Jiang, Jinyang Gao, Yingxia Shao, Ce Zhang, and Bin Cui. 2020 · 2020
Later among the works it cites.
Mumbo: Multi-task max-value bayesian optimization. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases . Springer, 447–462
Henry B Moss, David S Leslie, and Paul Rayson. 2020 · 2020
Later among the works it cites.
A quantile-based approach for hyperparameter transfer learning. In International Conference on Machine Learning . PMLR, 8438–8448
David Salinas, Huibin Shen, and Valerio Perrone. 2020 · 2020
Later among the works it cites.
A comprehensive survey on transfer learning
Fuzhen Zhuang, Zhiyuan Qi, Keyu Duan, Dongbo Xi, Yongchun Zhu, Hengshu Zhu, Hui Xiong, and Qing He. 2020 · 2020
Later among the works it cites.
Bayesian optimization with safety constraints: safe and automatic parameter tuning in robotics
Felix Berkenkamp, Andreas Krause, and Angela P Schoellig. 2021 · 2021
Later among the works it cites.
Hyperparameter transfer learning with adaptive complexity. In International Conference on Artificial Intelligence and Statistics . PMLR, 1378–1386
Samuel Horváth, Aaron Klein, Peter Richtárik, and Cédric Archambeau. 2021 · 2021
Later among the works it cites.
Reinforced few-shot acquisition function learning for bayesian optimization
Bing-Jing Hsieh, Ping-Chun Hsieh, and Xi Liu. 2021 · 2021
Later among the works it cites.
End-to-End Learning of Deep Kernel Acquisition Functions for Bayesian Optimization
Tomoharu Iwata. 2021 · 2021
Later among the works it cites.
Transfer Learning for Bayesian HPO with End-to-End Landmark Meta-Features. In Fifth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems
Hadi Samer Jomaa, Sebastian Pineda Arango, Lars Schmidt-Thieme, and Josif Grabocka. 2021 · 2021
Later among the works it cites.
VolcanoML: Speeding up End-to-End AutoML via Scalable Search Space Decomposition
Yang Li, Yu Shen, Wentao Zhang, Jiawei Jiang, Bolin Ding, Yaliang Li, Jingren Zhou, Zhi Yang, Wentao Wu, Ce Zhang, and Bin Cui. 2021c · 2021
Later among the works it cites.
Bayesian Optimization with a Prior for the Optimum. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases . Springer, 265–296
Artur Souza, Luigi Nardi, Leonardo B Oliveira, Kunle Olukotun, Marius Lindauer, and Frank Hutter. 2021 · 2021
Later among the works it cites.
Black-box optimization for automated discovery
Kei Terayama, Masato Sumita, Ryo Tamura, and Koji Tsuda. 2021 · 2021
Later among the works it cites.
Zi Wang, George E Dahl, Kevin Swersky, Chansoo Lee, Zelda Mariet, Zack Nado, Justin Gilmer, Jasper Snoek, and Zoubin Ghahramani. 2021 · 2021
Later among the works it cites.
Meta-learning Hyperparameter Performance Prediction with Neural Processes. In International Conference on Machine Learning . PMLR, 11058–11067
Ying Wei, Peilin Zhao, and Junzhou Huang. 2021 · 2021
Later among the works it cites.
Few-shot bayesian optimization with deep kernel surrogates
Martin Wistuba and Josif Grabocka. 2021 · 2021
Later among the works it cites.
Facilitating Database Tuning with Hyper-Parameter Optimization: A Comprehensive Experimental Evaluation
Xinyi Zhang, Zhuo Chang, Yang Li, Hong Wu, Jian Tan, Feifei Li, and Bin Cui. 2021a · 2021
Later among the works it cites.
Transfer Learning based Search Space Design for Hyperparameter Tuning
Yang Li, Yu Shen, Huaijun Jiang, Tianyi Bai, Wentao Zhang, Ce Zhang, and Bin Cui. 2022a · 2022
Later among the works it cites.
Hyper-Tune: Towards Efficient Hyper-Parameter Tuning at Scale
Yang Li, Yu Shen, Huaijun Jiang, Wentao Zhang, Jixiang Li, Ji Liu, Ce Zhang, and Bin Cui. 2022b · 2022
Later among the works it cites.
TransBO: Hyperparameter Optimization via Two-Phase Transfer Learning
Yang Li, Yu Shen, Huaijun Jiang, Wentao Zhang, Zhi Yang, Ce Zhang, and Bin Cui. 2022c · 2022
Later among the works it cites.
Efficient End-to-End AutoML via Scalable Search Space Decomposition
Yang Li, Yu Shen, Wentao Zhang, Ce Zhang, and Bin Cui. 2022d · 2022
Later among the works it cites.
Transfer Learning with Gaussian Processes for Bayesian Optimization. In International Conference on Artificial Intelligence and Statistics . PMLR, 6152–6181
Petru Tighineanu, Kathrin Skubch, Paul Baireuther, Attila Reiss, Felix Berkenkamp, and Julia Vinogradska. 2022 · 2022
Later among the works it cites.
Industry practice of configuration auto-tuning for cloud applications and services. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering . 1555–1565
Runzhe Wang, Qinglong Wang, Yuxi Hu, Heyuan Shi, Yuheng Shen, Yu Zhan, Ying Fu, Zheng Liu, Xiaohai Shi, and Yu Jiang. 2022 · 2022
Later among the works it cites.
Towards Dynamic and Safe Configuration Tuning for Cloud Databases
Xinyi Zhang, Hong Wu, Yang Li, Jian Tan, Feifei Li, and Bin Cui. 2022a · 2022
Later among the works it cites.