Fetching the paper…
Reading the bibliography…
To solve a machine learning problem, one typically needs to perform data preprocessing, modeling, and hyperparameter tuning, which is known as model selection and hyperparameter optimization.The goal of automated machine learning (AutoML) is to design methods that can automatically perform model selection and hyperparameter optimization without human interventions for a given dataset.
1904
Earlier work this paper cites.
C. M. Bishop, Pattern recognition and machine learning . Springer-Verlag New York, Inc., 2006
2006
Earlier work this paper cites.
M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, “The weka data mining software: an update,” ACM SIGKDD explorations newsletter , vol. 11, no. 1, pp. 10–18, 2009
2009
Earlier work this paper cites.
2010
Earlier work this paper cites.
F. Hutter, H. H. Hoos, and K. Leyton-Brown, “Sequential model-based optimization for general algorithm configuration,” in International Conference on Learning and Intelligent Optimization . Springer, 2011, pp. 507–523
2011
Earlier work this paper cites.
J. Bergstra and Y. Bengio, “Random search for hyper-parameter optimization,” Journal of Machine Learning Research , vol. 13, no. Feb, pp. 281–305, 2012
2012
Earlier work this paper cites.
J. Snoek, H. Larochelle, and R. P. Adams, “Practical bayesian optimization of machine learning algorithms,” in Advances in neural information processing systems , 2012, pp. 2951–2959
2012
Earlier work this paper cites.
R. M. Neal, Bayesian learning for neural networks . Springer Science & Business Media, 2012, vol. 118
2012
Earlier work this paper cites.
T. Chen, E. Fox, and C. Guestrin, “Stochastic gradient hamiltonian monte carlo,” in International Conference on Machine Learning , 2014, pp. 1683–1691
2014
Earlier work this paper cites.
M. Feurer, A. Klein, K. Eggensperger, J. Springenberg, M. Blum, and F. Hutter, “Efficient and robust automated machine learning,” in Advances in Neural Information Processing Systems , 2015, pp. 2962–2970
2015
Earlier work this paper cites.
J. M. Hernández-Lobato and R. Adams, “Probabilistic backpropagation for scalable learning of bayesian neural networks,” in International Conference on Machine Learning , 2015, pp. 1861–1869
2015
Cited alongside, same era.
D. P. Kingma, T. Salimans, and M. Welling, “Variational dropout and the local reparameterization trick,” in Advances in Neural Information Processing Systems 28 , 2015, pp. 2575–2583
2015
Cited alongside, same era.
J. Snoek, O. Rippel, K. Swersky, R. Kiros, N. Satish, N. Sundaram, M. Patwary, M. Prabhat, and R. Adams, “Scalable bayesian optimization using deep neural networks,” in International Conference on Machine Learning , 2015, pp. 2171–2180
2015
Cited alongside, same era.
M. Feurer, J. T. Springenberg, and F. Hutter, “Initializing bayesian hyperparameter optimization via meta-learning.” in AAAI , 2015, pp. 1128–1135
2015
Cited alongside, same era.
B. Baker, O. Gupta, N. Naik, and R. Raskar, “Designing neural network architectures using reinforcement learning,” International Conference on Learning Representations , 2017
2017
Later among the works it cites.
E. Real, S. Moore, A. Selle, S. Saxena, Y. L. Suematsu, J. Tan, Q. V. Le, and A. Kurakin, “Large-scale evolution of image classifiers,” in Proceedings of the 34th International Conference on Machine Learning , vol. 70, 06–11 Aug 2017, pp. 2902–2911
2017
Later among the works it cites.
L. Xie and A. L. Yuille, “Genetic cnn.” in ICCV , 2017, pp. 1388–1397
2017
Later among the works it cites.
L. Kotthoff, C. Thornton, H. H. Hoos, F. Hutter, and K. Leyton-Brown, “Auto-weka 2.0: Automatic model selection and hyperparameter optimization in weka,” The Journal of Machine Learning Research , vol. 18, no. 1, pp. 826–830, 2017
2017
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
I. Guyon, I. Chaabane, H. J. Escalante, S. Escalera, D. Jajetic, J. R. Lloyd, N. Macià, B. Ray, L. Romaszko, M. Sebag et al. , “A brief review of the chalearn automl challenge: any-time any-dataset learning without human intervention,” in Workshop on Automatic Machine Learning , 2016, pp. 21–30
2016
Cited alongside, same era.
Z. Wang, F. Hutter, M. Zoghi, D. Matheson, and N. de Feitas, “Bayesian optimization in a billion dimensions via random embeddings,” Journal of Artificial Intelligence Research , vol. 55, pp. 361–387, 2016
2016
Cited alongside, same era.
R. S. Olson, N. Bartley, R. J. Urbanowicz, and J. H. Moore, “Evaluation of a tree-based pipeline optimization tool for automating data science,” in Proceedings of the Genetic and Evolutionary Computation Conference 2016 . ACM, 2016, pp. 485–492
2016
Cited alongside, same era.
Y. Gal and Z. Ghahramani, “Dropout as a bayesian approximation: Representing model uncertainty in deep learning,” in international conference on machine learning , 2016, pp. 1050–1059
2016
Cited alongside, same era.
L. Li, K. Jamieson, G. DeSalvo, A. Rostamizadeh, and A. Talwalkar, “Hyperband: A novel bandit-based approach to hyperparameter optimization,” The Journal of Machine Learning Research , vol. 18, no. 1, pp. 6765–6816, 2017
2017
Cited alongside, same era.
2017
Cited alongside, same era.
V. Perrone, R. Jenatton, M. W. Seeger, and C. Archambeau, “Scalable hyperparameter transfer learning,” in Advances in Neural Information Processing Systems 31
Cited in the paper.
D. Dheeru and E. Karra Taniskidou, “UCI machine learning repository,” 2017. [Online]. Available: http://archive.ics.uci.edu/ml
2017
Later among the works it cites.
J. Li and F.-F. Li, “Cloud automl: Making ai accessible to every business,” Internet: https://www. blog. google/topics/google-cloud/cloud-automl-making-ai-accessible-everybusiness , 2018
2018
Later among the works it cites.
B. Zoph, V. Vasudevan, J. Shlens, and Q. V. Le, “Learning transferable architectures for scalable image recognition,” in CVPR , 2018
2018
Later among the works it cites.
C. Liu, B. Zoph, M. Neumann, J. Shlens, W. Hua, L.-J. Li, L. Fei-Fei, A. L. Yuille, J. Huang, and K. Murphy, “Progressive neural architecture search,” in ECCV , 2018
2018
Later among the works it cites.
N. Fusi, R. Sheth, and M. Elibol, “Probabilistic matrix factorization for automated machine learning,” in Advances in Neural Information Processing Systems 31 , 2018, pp. 3352–3361
2018
Later among the works it cites.