Adaptive Stochastic Natural Gradient Method for One-Shot Neural Architecture Search

Natural Gradient Works Efficiently in Learning

Amari, S · 1998

Earlier work this paper cites.

Approximating integrals via Monte Carlo and deterministic methods

Evans, M. J. and Swartz, T · 2000

Earlier work this paper cites.

Image Quality Assessment: From Error Visibility to Structural Similarity

Wang, Z., Bovik, A., Sheikh, H., and Simoncelli, E · 2004

Earlier work this paper cites.

Stochastic approximation: a dynamical systems viewpoint

Borkar, V. S · 2008

Earlier work this paper cites.

Objective improvement in information-geometric optimization

Akimoto, Y. and Ollivier, Y · 2013

Earlier work this paper cites.

Adam: A Method for Stochastic Optimization

Kingma, D. P. and Ba, J · 2015

Earlier work this paper cites.

Deep Learning Face Attributes in the Wild

Liu, Z., Luo, P., Wang, X., and Tang, X · 2015

Earlier work this paper cites.

Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections

Mao, X., Shen, C., and Yang, Y · 2016

Earlier work this paper cites.

Context Encoders: Feature Learning by Inpainting

Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., and Efros, A. A · 2016

Earlier work this paper cites.

Rethinking the Inception Architecture for Computer Vision

Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z · 2016

Earlier work this paper cites.

Xception: Deep Learning with Depthwise Separable Convolutions

Chollet, F · 2017

Cited alongside, same era.

Improved Regularization of Convolutional Neural Networks with Cutout

DeVries, T. and Taylor, G. W · 2017

Cited alongside, same era.

SGDR: Stochastic Gradient Descent with Warm Restarts

Loshchilov, I. and Hutter, F · 2017

Cited alongside, same era.

Information-Geometric Optimization Algorithms: A Unifying Picture via Invariance Principles

Ollivier, Y., Arnold, L., Auger, A., and Hansen, N · 2017

Cited alongside, same era.

Automatic differentiation in PyTorch

Paszke, A., Chanan, G., Lin, Z., Gross, S., Yang, E., Antiga, L., and Devito, Z · 2017

Cited alongside, same era.

Large-Scale Evolution of Image Classifiers

Real, E., Moore, S., Selle, A., Saxena, S., Suematsu, Y. L., Tan, J., Le, Q. V., and Kurakin, A · 2017

Cited alongside, same era.

Neural Architecture Optimization

Luo, R., Tian, F., Qin, T., Chen, E., and Liu, T · 2018

Later among the works it cites.

Efficient Neural Architecture Search via Parameter Sharing

Pham, H., Guan, M. Y., Zoph, B., Le, Q. V., and Dean, J · 2018

Later among the works it cites.

Dynamic Optimization of Neural Network Structures Using Probabilistic Modeling

Shirakawa, S., Iwata, Y., and Akimoto, Y · 2018

Later among the works it cites.

Exploiting the Potential of Standard Convolutional Autoencoders for Image Restoration by Evolutionary Search

Suganuma, M., Ozay, M., and Okatani, T · 2018

Later among the works it cites.

Learning Transferable Architectures for Scalable Image Recognition

Original

Zoph, B., Vasudevan, V., Shlens, J., and Le, Q. V · 2018

Later among the works it cites.