Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap · Around

Fetching the paper…

Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap · Around

Built on

J. Schmidhuber, “Evolutionary principles in self-referential learning, or on learning how to learn: the meta-meta-… hook,” Ph.D. dissertation, Technische Universität München, 1987
1987
Earlier work this paper cites.
X. Yao, “Evolving artificial neural networks,” Proceedings of the IEEE , vol. 87, no. 9, pp. 1423–1447, 1999
1999
Earlier work this paper cites.
K. O. Stanley and R. Miikkulainen, “Evolving neural networks through augmenting topologies,” Evolutionary computation , vol. 10, no. 2, pp. 99–127, 2002
2002
Earlier work this paper cites.
D. G. Lowe, “Distinctive image features from scale-invariant keypoints,” International Journal of Computer Vision , vol. 60, no. 2, pp. 91–110, 2004
2004
Earlier work this paper cites.
J. Bayer, D. Wierstra, J. Togelius, and J. Schmidhuber, “Evolving memory cell structures for sequence learning,” in International Conference on Artificial Neural Networks , 2009
2009
Earlier work this paper cites.
A. Krizhevsky and G. Hinton, “Learning multiple layers of features from tiny images,” Tech. Rep., 2009
2009
Earlier work this paper cites.
J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in Computer Vision and Pattern Recognition , 2009
2009
Earlier work this paper cites.
V. Nair and G. E. Hinton, “Rectified linear units improve restricted boltzmann machines,” in International Conference on Machine Learning , 2010
2010
Earlier work this paper cites.
T. Schaul and J. Schmidhuber, “Metalearning,” Scholarpedia , vol. 5, no. 6, p. 4650, 2010
2010
Earlier work this paper cites.
J. S. Bergstra, R. Bardenet, Y. Bengio, and B. Kégl, “Algorithms for hyper-parameter optimization,” in Advances in Neural Information Processing Systems , 2011
2011
Earlier work this paper cites.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” in Advances in Neural Information Processing Systems , 2012
2012
Earlier work this paper cites.
J. Bergstra and Y. Bengio, “Random search for hyper-parameter optimization,” Journal of Machine Learning Research , vol. 13, no. 1, pp. 281–305, 2012
2012
Earlier work this paper cites.
J. Snoek, H. Larochelle, and R. P. Adams, “Practical bayesian optimization of machine learning algorithms,” in Advances in neural information processing systems , 2012, pp. 2951–2959
2012
Earlier work this paper cites.
C. Thornton, F. Hutter, H. H. Hoos, and K. Leyton-Brown, “Auto-weka: Combined selection and hyperparameter optimization of classification algorithms,” in SIGKDD International Conference on Knowledge Discovery and Data Mining , 2013
2013
Earlier work this paper cites.
S. Ding, H. Li, C. Su, J. Yu, and F. Jin, “Evolutionary artificial neural networks: a review,” Artificial Intelligence Review , vol. 39, no. 3, pp. 251–260, 2013
2013
Earlier work this paper cites.
I. Sutskever, J. Martens, G. Dahl, and G. Hinton, “On the importance of initialization and momentum in deep learning,” in International Conference on Machine Learning , 2013
2013
Earlier work this paper cites.
J. Bergstra, D. Yamins, and D. Cox, “Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures,” in International Conference on Machine Learning , 2013
2013
Earlier work this paper cites.
A. Toshev and C. Szegedy, “Deeppose: Human pose estimation via deep neural networks,” in Computer Vision and Pattern Recognition , 2014
2014
Earlier work this paper cites.
N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, “Dropout: a simple way to prevent neural networks from overfitting,” Journal of Machine Learning Research , vol. 15, no. 1, pp. 1929–1958, 2014
2014
Earlier work this paper cites.
Y. Gong, L. Liu, M. Yang, and L. Bourdev, “Compressing deep convolutional networks using vector quantization,” arXiv preprint arXiv:1412.6115 , 2014
Original
2014
Earlier work this paper cites.
Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature , vol. 521, no. 7553, pp. 436–444, 2015
2015
Earlier work this paper cites.
K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” in International Conference on Learning Representations , 2015
2015
Earlier work this paper cites.
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,” in Computer Vision and Pattern Recognition , 2015
2015
Earlier work this paper cites.
R. Girshick, “Fast r-cnn,” in International Conference on Computer Vision , 2015
2015
Earlier work this paper cites.
S. Ren, K. He, R. Girshick, and J. Sun, “Faster r-cnn: Towards real-time object detection with region proposal networks,” in Advances in Neural Information Processing Systems , 2015
2015
Earlier work this paper cites.
J. Long, E. Shelhamer, and T. Darrell, “Fully convolutional networks for semantic segmentation,” in Computer Vision and Pattern Recognition , 2015
2015
Earlier work this paper cites.
S. Xie and Z. Tu, “Holistically-nested edge detection,” in International Conference on Computer Vision , 2015
2015
Earlier work this paper cites.
O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein et al. , “Imagenet large scale visual recognition challenge,” International journal of computer vision , vol. 115, no. 3, pp. 211–252, 2015
2015
Earlier work this paper cites.
S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” in International Conference on Machine Learning , 2015
2015
Earlier work this paper cites.
S. Han, J. Pool, J. Tran, and W. Dally, “Learning both weights and connections for efficient neural network,” in Advances in Neural Information Processing Systems , 2015
2015
Earlier work this paper cites.
W. Chen, J. Wilson, S. Tyree, K. Weinberger, and Y. Chen, “Compressing neural networks with the hashing trick,” in International Conference on Machine Learning , 2015
2015
Earlier work this paper cites.
C. Lemke, M. Budka, and B. Gabrys, “Metalearning: a survey of trends and technologies,” Artificial Intelligence Review , vol. 44, no. 1, pp. 117–130, 2015
2015
Earlier work this paper cites.
M. Claesen and B. De Moor, “Hyperparameter search in machine learning,” arXiv preprint arXiv:1502.02127 , 2015
Original
2015
Earlier work this paper cites.
D. Maclaurin, D. Duvenaud, and R. Adams, “Gradient-based hyperparameter optimization through reversible learning,” in International Conference on Machine Learning , 2015
2015
Earlier work this paper cites.
S. R. Young, D. C. Rose, T. P. Karnowski, S.-H. Lim, and R. M. Patton, “Optimizing deep learning hyper-parameters through an evolutionary algorithm,” in Workshop on Machine Learning in High-Performance Computing Environments , 2015
2015
Earlier work this paper cites.
M. Feurer, J. T. Springenberg, and F. Hutter, “Initializing bayesian hyperparameter optimization via meta-learning,” in AAAI Conference on Artificial Intelligence , 2015
2015
Earlier work this paper cites.
G. Hinton, O. Vinyals, and J. Dean, “Distilling the knowledge in a neural network,” arXiv preprint arXiv:1503.02531 , 2015
Original
2015
Earlier work this paper cites.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Computer Vision and Pattern Recognition , 2016
2016
Earlier work this paper cites.
J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: Unified, real-time object detection,” in Computer Vision and Pattern Recognition , 2016
2016
Earlier work this paper cites.
W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.-Y. Fu, and A. C. Berg, “Ssd: Single shot multibox detector,” in European Conference on Computer Vision , 2016
2016
Earlier work this paper cites.
S. Merity, C. Xiong, J. Bradbury, and R. Socher, “Pointer sentinel mixture models,” arXiv preprint arXiv:1609.07843 , 2016
Original
2016
Earlier work this paper cites.
S. C. Smithson, G. Yang, W. J. Gross, and B. H. Meyer, “Neural networks designing neural networks: multi-objective hyper-parameter optimization,” in International Conference on Computer-Aided Design , 2016
2016
Earlier work this paper cites.
T. Chen, I. Goodfellow, and J. Shlens, “Net2net: Accelerating learning via knowledge transfer,” in International Conference on Learning Representations , 2016
2016
Earlier work this paper cites.
T. Wei, C. Wang, Y. Rui, and C. W. Chen, “Network morphism,” in International Conference on Machine Learning , 2016
2016
Earlier work this paper cites.
J. Wang, Z. Wei, T. Zhang, and W. Zeng, “Deeply-fused nets,” arXiv preprint arXiv:1605.07716 , 2016
Original
2016
Earlier work this paper cites.
S. Saxena and J. Verbeek, “Convolutional neural fabrics,” in Advances in Neural Information Processing Systems , 2016
2016
Earlier work this paper cites.
S. Han, H. Mao, and W. J. Dally, “Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding,” in International Conference on Learning Representations , 2016
2016
Earlier work this paper cites.
F. N. Iandola, S. Han, M. W. Moskewicz, K. Ashraf, W. J. Dally, and K. Keutzer, “Squeezenet: Alexnet-level accuracy with 50x fewer parameters and¡ 0.5 mb model size,” arXiv preprint arXiv:1602.07360 , 2016
Original
2016
Earlier work this paper cites.
M. Rastegari, V. Ordonez, J. Redmon, and A. Farhadi, “Xnor-net: Imagenet classification using binary convolutional neural networks,” in European Conference on Computer Vision , 2016
2016
Earlier work this paper cites.
O. Vinyals, C. Blundell, T. Lillicrap, D. Wierstra et al. , “Matching networks for one shot learning,” in Advances in Neural Information Processing Systems , 2016
2016
Earlier work this paper cites.
A. Santoro, S. Bartunov, M. Botvinick, D. Wierstra, and T. Lillicrap, “Meta-learning with memory-augmented neural networks,” in International Conference on Machine Learning , 2016
2016
Earlier work this paper cites.
Y. Duan, J. Schulman, X. Chen, P. L. Bartlett, I. Sutskever, and P. Abbeel, “Rlˆ2: Fast reinforcement learning via slow reinforcement learning,” arXiv preprint arXiv:1611.02779 , 2016
Original
2016
Earlier work this paper cites.
K. Li and J. Malik, “Learning to optimize,” arXiv preprint arXiv:1606.01885 , 2016
Original
2016
Earlier work this paper cites.
M. Andrychowicz, M. Denil, S. Gomez, M. W. Hoffman, D. Pfau, T. Schaul, B. Shillingford, and N. De Freitas, “Learning to learn by gradient descent by gradient descent,” in Advances in Neural Information Processing Systems , 2016
2016
Earlier work this paper cites.
H. Mendoza, A. Klein, M. Feurer, J. T. Springenberg, and F. Hutter, “Towards automatically-tuned neural networks,” in Workshop on Automatic Machine Learning , 2016
2016
Earlier work this paper cites.
I. Loshchilov and F. Hutter, “Cma-es for hyperparameter optimization of deep neural networks,” arXiv preprint arXiv:1604.07269 , 2016
Original
2016
Earlier work this paper cites.
G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger, “Densely connected convolutional networks,” in Computer Vision and Pattern Recognition , 2017
2017
Earlier work this paper cites.
L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, “Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs,” IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 40, no. 4, pp. 834–848, 2017
2017
Earlier work this paper cites.
K. He, G. Gkioxari, P. Dollár, and R. Girshick, “Mask r-cnn,” in International Conference on Computer Vision , 2017
2017
Earlier work this paper cites.
E. Real, S. Moore, A. Selle, S. Saxena, Y. L. Suematsu, J. Tan, Q. V. Le, and A. Kurakin, “Large-scale evolution of image classifiers,” in International Conference on Machine Learning , 2017
2017
Earlier work this paper cites.
L. Xie and A. Yuille, “Genetic cnn,” in International Conference on Computer Vision , 2017
2017
Earlier work this paper cites.
B. Zoph and Q. V. Le, “Neural architecture search with reinforcement learning,” in International Conference on Learning Representations , 2017
2017
Earlier work this paper cites.
A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, “Mobilenets: Efficient convolutional neural networks for mobile vision applications,” arXiv preprint arXiv:1704.04861 , 2017
Original
2017
Earlier work this paper cites.
A. Brock, T. Lim, J. M. Ritchie, and N. Weston, “Smash: one-shot model architecture search through hypernetworks,” arXiv preprint arXiv:1708.05344 , 2017
Original
2017
Earlier work this paper cites.
C. Cortes, X. Gonzalvo, V. Kuznetsov, M. Mohri, and S. Yang, “Adanet: Adaptive structural learning of artificial neural networks,” in International Conference on Machine Learning , 2017
2017
Earlier work this paper cites.
B. Baker, O. Gupta, N. Naik, and R. Raskar, “Designing neural network architectures using reinforcement learning,” in International Conference on Learning Representations , 2017
2017
Earlier work this paper cites.
M. Suganuma, S. Shirakawa, and T. Nagao, “A genetic programming approach to designing convolutional neural network architectures,” in Genetic and Evolutionary Computation Conference , 2017
2017
Earlier work this paper cites.
R. Negrinho and G. Gordon, “Deeparchitect: Automatically designing and training deep architectures,” arXiv preprint arXiv:1704.08792 , 2017
Original
2017
Earlier work this paper cites.
B. Baker, O. Gupta, R. Raskar, and N. Naik, “Accelerating neural architecture search using performance prediction,” arXiv preprint arXiv:1705.10823 , 2017
Original
2017
Earlier work this paper cites.
T. Wei, C. Wang, and C. W. Chen, “Modularized morphing of neural networks,” arXiv preprint arXiv:1701.03281 , 2017
Original
2017
Earlier work this paper cites.
T. Elsken, J.-H. Metzen, and F. Hutter, “Simple and efficient architecture search for convolutional neural networks,” arXiv preprint arXiv:1711.04528 , 2017
Original
2017
Earlier work this paper cites.
M. Wistuba, “Finding competitive network architectures within a day using uct,” arXiv preprint arXiv:1712.07420 , 2017
Original
2017
Earlier work this paper cites.
F. Chollet, “Xception: Deep learning with depthwise separable convolutions,” in Computer Vision and Pattern Recognition , 2017
2017
Earlier work this paper cites.
M. Schrimpf, S. Merity, J. Bradbury, and R. Socher, “A flexible approach to automated rnn architecture generation,” arXiv preprint arXiv:1712.07316 , 2017
Original
2017
Earlier work this paper cites.
B. Deng, J. Yan, and D. Lin, “Peephole: Predicting network performance before training,” arXiv preprint arXiv:1712.03351 , 2017
Original
2017
Earlier work this paper cites.
T.-J. Yang, Y.-H. Chen, and V. Sze, “Designing energy-efficient convolutional neural networks using energy-aware pruning,” in Computer Vision and Pattern Recognition , 2017
2017
Earlier work this paper cites.
V. Sze, Y.-H. Chen, T.-J. Yang, and J. S. Emer, “Efficient processing of deep neural networks: A tutorial and survey,” Proceedings of the IEEE , vol. 105, no. 12, pp. 2295–2329, 2017
2017
Earlier work this paper cites.
I. Hubara, M. Courbariaux, D. Soudry, R. El-Yaniv, and Y. Bengio, “Quantized neural networks: Training neural networks with low precision weights and activations,” The Journal of Machine Learning Research , vol. 18, no. 1, pp. 6869–6898, 2017
2017
Earlier work this paper cites.
M. McGill and P. Perona, “Deciding how to decide: Dynamic routing in artificial neural networks,” arXiv preprint arXiv:1703.06217 , 2017
Original
2017
Earlier work this paper cites.
B. M. Lake, T. D. Ullman, J. B. Tenenbaum, and S. J. Gershman, “Building machines that learn and think like people,” Behavioral and Brain Sciences , vol. 40, 2017
2017
Earlier work this paper cites.
C. Finn, T. Yu, T. Zhang, P. Abbeel, and S. Levine, “One-shot visual imitation learning via meta-learning,” arXiv preprint arXiv:1709.04905 , 2017
Original
2017
Earlier work this paper cites.
J. Snell, K. Swersky, and R. Zemel, “Prototypical networks for few-shot learning,” in Advances in Neural Information Processing Systems , 2017
2017
Earlier work this paper cites.
S. Ravi and H. Larochelle, “Optimization as a model for few-shot learning,” in International Conference on Learning Representations , 2017
2017
Earlier work this paper cites.
C. Finn, P. Abbeel, and S. Levine, “Model-agnostic meta-learning for fast adaptation of deep networks,” in International Conference on Machine Learning , 2017
2017
Earlier work this paper cites.
I. Loshchilov and F. Hutter, “Sgdr: Stochastic gradient descent with warm restarts,” in International Conference on Learning Representations , 2017
2017
Earlier work this paper cites.
L. Li, K. Jamieson, G. DeSalvo, A. Rostamizadeh, and A. Talwalkar, “Hyperband: A novel bandit-based approach to hyperparameter optimization,” The Journal of Machine Learning Research , vol. 18, no. 1, pp. 6765–6816, 2017
2017
Earlier work this paper cites.
I. Bello, B. Zoph, V. Vasudevan, and Q. V. Le, “Neural optimizer search with reinforcement learning,” in International Conference on Machine Learning , 2017
2017
Earlier work this paper cites.
S. Xie, R. Girshick, P. Dollár, Z. Tu, and K. He, “Aggregated residual transformations for deep neural networks,” in Computer Vision and Pattern Recognition , 2017
2017
Earlier work this paper cites.
P. Ramachandran, B. Zoph, and Q. V. Le, “Searching for activation functions,” arXiv preprint arXiv:1710.05941 , 2017
Original
2017
Earlier work this paper cites.
H. Cai, T. Chen, W. Zhang, Y. Yu, and J. Wang, “Efficient architecture search by network transformation,” in AAAI Conference on Artificial Intelligence , 2018
2018
Earlier work this paper cites.
H. Pham, M. Y. Guan, B. Zoph, Q. V. Le, and J. Dean, “Efficient neural architecture search via parameter sharing,” in International Conference on Machine Learning , 2018
2018
Earlier work this paper cites.
H. Liu, K. Simonyan, O. Vinyals, C. Fernando, and K. Kavukcuoglu, “Hierarchical representations for efficient architecture search,” in International Conference on Learning Representations , 2018
2018
Earlier work this paper cites.
B. Zoph, V. Vasudevan, J. Shlens, and Q. V. Le, “Learning transferable architectures for scalable image recognition,” in Computer Vision and Pattern Recognition , 2018
2018
Earlier work this paper cites.
C. Liu, B. Zoph, M. Neumann, J. Shlens, W. Hua, L.-J. Li, L. Fei-Fei, A. Yuille, J. Huang, and K. Murphy, “Progressive neural architecture search,” in European Conference on Computer Vision , 2018
2018
Earlier work this paper cites.
Y. Zhou, S. Ebrahimi, S. Ö. Arık, H. Yu, H. Liu, and G. Diamos, “Resource-efficient neural architect,” arXiv preprint arXiv:1806.07912 , 2018
Original
2018
Earlier work this paper cites.
Z. Zhong, J. Yan, W. Wu, J. Shao, and C.-L. Liu, “Practical block-wise neural network architecture generation,” in Computer Vision and Pattern Recognition , 2018
2018
Earlier work this paper cites.
G. Bender, P.-J. Kindermans, B. Zoph, V. Vasudevan, and Q. Le, “Understanding and simplifying one-shot architecture search,” in International Conference on Machine Learning , 2018
2018
Earlier work this paper cites.
R. Luo, F. Tian, T. Qin, E. Chen, and T.-Y. Liu, “Neural architecture optimization,” in Advances in Neural Information Processing Systems , 2018
2018
Earlier work this paper cites.
J. Liang, E. Meyerson, and R. Miikkulainen, “Evolutionary architecture search for deep multitask networks,” in Genetic and Evolutionary Computation Conference , 2018
2018
Earlier work this paper cites.
J.-M. Pérez-Rúa, M. Baccouche, and S. Pateux, “Efficient progressive neural architecture search,” arXiv preprint arXiv:1808.00391 , 2018
Original
2018
Earlier work this paper cites.
X. Zhang, Z. Huang, and N. Wang, “You only search once: Single shot neural architecture search via direct sparse optimization,” arXiv preprint arXiv:1811.01567 , 2018
Original
2018
Earlier work this paper cites.
K. Kandasamy, W. Neiswanger, J. Schneider, B. Poczos, and E. P. Xing, “Neural architecture search with bayesian optimisation and optimal transport,” in Advances in Neural Information Processing Systems , 2018
2018
Earlier work this paper cites.
B. Wang, Y. Sun, B. Xue, and M. Zhang, “Evolving deep convolutional neural networks by variable-length particle swarm optimization for image classification,” in IEEE Congress on Evolutionary Computation , 2018
2018
Earlier work this paper cites.
Y. Sun, G. G. Yen, and Z. Yi, “Evolving unsupervised deep neural networks for learning meaningful representations,” IEEE Transactions on Evolutionary Computation , vol. 23, no. 1, pp. 89–103, 2018
2018
Earlier work this paper cites.
Y. Sun, B. Xue, M. Zhang, and G. G. Yen, “A particle swarm optimization-based flexible convolutional autoencoder for image classification,” IEEE Transactions on Neural Networks and Learning Systems , vol. 30, no. 8, pp. 2295–2309, 2018
2018
Earlier work this paper cites.
J. K. Dutta, J. Liu, U. Kurup, and M. Shah, “Effective building block design for deep convolutional neural networks using search,” arXiv preprint arXiv:1801.08577 , 2018
Original
2018
Earlier work this paper cites.
R. Shin, C. Packer, and D. Song, “Differentiable neural network architecture search,” in International Conference on Learning Representations: Workshops , 2018
2018
Earlier work this paper cites.
P. Kamath, A. Singh, and D. Dutta, “Neural architecture construction using envelopenets,” arXiv preprint arXiv:1803.06744 , 2018
Original
2018
Earlier work this paper cites.
H. Cai, J. Yang, W. Zhang, S. Han, and Y. Yu, “Path-level network transformation for efficient architecture search,” in International Conference on Machine Learning , 2018
2018
Earlier work this paper cites.
J.-D. Dong, A.-C. Cheng, D.-C. Juan, W. Wei, and M. Sun, “Dpp-net: Device-aware progressive search for pareto-optimal neural architectures,” in European Conference on Computer Vision , 2018
2018
Earlier work this paper cites.
H. Jin, Q. Song, and X. Hu, “Efficient neural architecture search with network morphism,” arXiv preprint arXiv:1806.10282 , 2018
Original
2018
Earlier work this paper cites.
C.-H. Hsu, S.-H. Chang, J.-H. Liang, H.-P. Chou, C.-H. Liu, S.-C. Chang, J.-Y. Pan, Y.-T. Chen, W. Wei, and D.-C. Juan, “Monas: Multi-objective neural architecture search using reinforcement learning,” arXiv preprint arXiv:1806.10332 , 2018
Original
2018
Earlier work this paper cites.
M. Wistuba, “Deep learning architecture search by neuro-cell-based evolution with function-preserving mutations,” in Joint European Conference on Machine Learning and Knowledge Discovery in Databases , 2018
2018
Earlier work this paper cites.
R. Y. Rohekar, S. Nisimov, Y. Gurwicz, G. Koren, and G. Novik, “Constructing deep neural networks by bayesian network structure learning,” in Advances in Neural Information Processing Systems , 2018
2018
Earlier work this paper cites.
J. Prellberg and O. Kramer, “Lamarckian evolution of convolutional neural networks,” in International Conference on Parallel Problem Solving from Nature , 2018
2018
Earlier work this paper cites.
P. R. Lorenzo and J. Nalepa, “Memetic evolution of deep neural networks,” in Genetic and Evolutionary Computation Conference , 2018
2018
Earlier work this paper cites.
B. Wang, Y. Sun, B. Xue, and M. Zhang, “A hybrid differential evolution approach to designing deep convolutional neural networks for image classification,” in Australasian Joint Conference on Artificial Intelligence , 2018
2018
Earlier work this paper cites.
A.-C. Cheng, J.-D. Dong, C.-H. Hsu, S.-H. Chang, M. Sun, S.-C. Chang, J.-Y. Pan, Y.-T. Chen, W. Wei, and D.-C. Juan, “Searching toward pareto-optimal device-aware neural architectures,” in International Conference on Computer-Aided Design , 2018
2018
Earlier work this paper cites.
Y. Sun, B. Xue, M. Zhang, and G. G. Yen, “Automatically evolving cnn architectures based on blocks,” arXiv preprint arXiv:1810.11875 , 2018
Original
2018
Earlier work this paper cites.
B. Fielding and L. Zhang, “Evolving image classification architectures with enhanced particle swarm optimisation,” IEEE Access , vol. 6, pp. 68 560–68 575, 2018
2018
Earlier work this paper cites.
B. Wu, Y. Wang, P. Zhang, Y. Tian, P. Vajda, and K. Keutzer, “Mixed precision quantization of convnets via differentiable neural architecture search,” arXiv preprint arXiv:1812.00090 , 2018
Original
2018
Earlier work this paper cites.
L.-C. Chen, M. Collins, Y. Zhu, G. Papandreou, B. Zoph, F. Schroff, H. Adam, and J. Shlens, “Searching for efficient multi-scale architectures for dense image prediction,” in Advances in Neural Information Processing Systems , 2018
2018
Earlier work this paper cites.
A. Mortazi and U. Bagci, “Automatically designing cnn architectures for medical image segmentation,” in International Workshop on Machine Learning in Medical Imaging , 2018
2018
Earlier work this paper cites.
J. Chen, K. Chen, X. Chen, X. Qiu, and X. Huang, “Exploring shared structures and hierarchies for multiple nlp tasks,” arXiv preprint arXiv:1808.07658 , 2018
Original
2018
Earlier work this paper cites.
C. Wong, N. Houlsby, Y. Lu, and A. Gesmundo, “Transfer learning with neural automl,” in Advances in Neural Information Processing Systems , 2018
2018
Earlier work this paper cites.
K. Maziarz, M. Tan, A. Khorlin, K.-Y. S. Chang, and A. Gesmundo, “Evolutionary-neural hybrid agents for architecture search,” arXiv preprint arXiv:1811.09828 , 2018
Original
2018
Earlier work this paper cites.
S. Huang, X. Li, Z.-Q. Cheng, Z. Zhang, and A. Hauptmann, “Gnas: A greedy neural architecture search method for multi-attribute learning,” in ACM International Conference on Multimedia , 2018
2018
Earlier work this paper cites.
L. Zhao, M. Li, D. Meng, X. Li, Z. Zhang, Y. Zhuang, Z. Tu, and J. Wang, “Deep convolutional neural networks with merge-and-run mappings,” in International Joint Conference on Artificial Intelligence , 2018
2018
Earlier work this paper cites.
A. Rawal and R. Miikkulainen, “From nodes to networks: Evolving recurrent neural networks,” arXiv preprint arXiv:1803.04439 , 2018
Original
2018
Earlier work this paper cites.
Z. Huang and N. Wang, “Data-driven sparse structure selection for deep neural networks,” in European Conference on Computer Vision , 2018
2018
Earlier work this paper cites.
A. Ashok, N. Rhinehart, F. Beainy, and K. M. Kitani, “N2n learning: Network to network compression via policy gradient reinforcement learning,” in International Conference on Learning Representations , 2018
2018
Earlier work this paper cites.
Y. He, J. Lin, Z. Liu, H. Wang, L.-J. Li, and S. Han, “Amc: Automl for model compression and acceleration on mobile devices,” in European Conference on Computer Vision , 2018
2018
Earlier work this paper cites.
Y. Chen, G. Meng, Q. Zhang, X. Zhang, L. Song, S. Xiang, and C. Pan, “Joint neural architecture search and quantization,” arXiv preprint arXiv:1811.09426 , 2018
Original
2018
Earlier work this paper cites.
K. Ahmed and L. Torresani, “Maskconnect: Connectivity learning by gradient descent,” in European Conference on Computer Vision , 2018
2018
Earlier work this paper cites.
A. Gordon, E. Eban, O. Nachum, B. Chen, H. Wu, T.-J. Yang, and E. Choi, “Morphnet: Fast & simple resource-constrained structure learning of deep networks,” in Computer Vision and Pattern Recognition , 2018
2018
Earlier work this paper cites.
L. Liu and J. Deng, “Dynamic deep neural networks: Optimizing accuracy-efficiency trade-offs by selective execution,” in AAAI Conference on Artificial Intelligence , 2018
2018
Earlier work this paper cites.
G. Huang, D. Chen, T. Li, F. Wu, L. van der Maaten, and K. Q. Weinberger, “Multi-scale dense networks for resource efficient image classification,” in International Conference on Learning Representations , 2018
2018
Earlier work this paper cites.
X. Wang, F. Yu, Z.-Y. Dou, T. Darrell, and J. E. Gonzalez, “Skipnet: Learning dynamic routing in convolutional networks,” in European Conference on Computer Vision , 2018
2018
Earlier work this paper cites.
Z. Wu, T. Nagarajan, A. Kumar, S. Rennie, L. S. Davis, K. Grauman, and R. Feris, “Blockdrop: Dynamic inference paths in residual networks,” in Computer Vision and Pattern Recognition , 2018
2018
Earlier work this paper cites.
M. Ren, E. Triantafillou, S. Ravi, J. Snell, K. Swersky, J. B. Tenenbaum, H. Larochelle, and R. S. Zemel, “Meta-learning for semi-supervised few-shot classification,” arXiv preprint arXiv:1803.00676 , 2018
Original
2018
Earlier work this paper cites.
N. Mishra, M. Rohaninejad, X. Chen, and P. Abbeel, “A simple neural attentive meta-learner,” in International Conference on Learning Representations , 2018
2018
Earlier work this paper cites.
J. Vanschoren, “Meta-learning: A survey,” arXiv preprint arXiv:1810.03548 , 2018
Original
2018
Earlier work this paper cites.
N. Mu, Z. Yao, A. Gholami, K. Keutzer, and M. Mahoney, “Parameter re-initialization through cyclical batch size schedules,” arXiv preprint arXiv:1812.01216 , 2018
Original
2018
Earlier work this paper cites.
Z. Yao, A. Gholami, Q. Lei, K. Keutzer, and M. W. Mahoney, “Hessian-based analysis of large batch training and robustness to adversaries,” in Advances in Neural Information Processing Systems , 2018
2018
Earlier work this paper cites.
S. Falkner, A. Klein, and F. Hutter, “Bohb: Robust and efficient hyperparameter optimization at scale,” arXiv preprint arXiv:1807.01774 , 2018
Original
2018
Earlier work this paper cites.
A. Zela, A. Klein, S. Falkner, and F. Hutter, “Towards automated deep learning: Efficient joint neural architecture and hyperparameter search,” arXiv preprint arXiv:1807.06906 , 2018
Original
2018
Earlier work this paper cites.
N. Ma, X. Zhang, H.-T. Zheng, and J. Sun, “Shufflenet v2: Practical guidelines for efficient cnn architecture design,” in European Conference on Computer Vision , 2018
2018
Earlier work this paper cites.
J. Hu, L. Shen, and G. Sun, “Squeeze-and-excitation networks,” in Computer Vision and Pattern Recognition , 2018
2018
Earlier work this paper cites.
H. Liu, K. Simonyan, and Y. Yang, “Darts: Differentiable architecture search,” in International Conference on Learning Representations , 2019
2019
Earlier work this paper cites.
T. Elsken, J. H. Metzen, and F. Hutter, “Neural architecture search: A survey,” Journal of Machine Learning Research , vol. 20, no. 55, pp. 1–21, 2019
2019
Earlier work this paper cites.
X. He, K. Zhao, and X. Chu, “Automl: A survey of the state-of-the-art,” arXiv preprint arXiv:1908.00709 , 2019
Original
2019
Earlier work this paper cites.
Y. Jaafra, J. L. Laurent, A. Deruyver, and M. S. Naceur, “Reinforcement learning for neural architecture search: A review,” Image and Vision Computing , vol. 89, pp. 57–66, 2019
2019
Earlier work this paper cites.
M. Wistuba, A. Rawat, and T. Pedapati, “A survey on neural architecture search,” arXiv preprint arXiv:1905.01392 , 2019
Original
2019
Earlier work this paper cites.
L. Wang, S. Xie, T. Li, R. Fonseca, and Y. Tian, “Sample-efficient neural architecture search by learning action space,” arXiv preprint arXiv:1906.06832 , 2019
Original
2019
Earlier work this paper cites.
E. Real, A. Aggarwal, Y. Huang, and Q. V. Le, “Regularized evolution for image classifier architecture search,” in AAAI Conference on Artificial Intelligence , 2019
2019
Earlier work this paper cites.
H. Zhou, M. Yang, J. Wang, and W. Pan, “Bayesnas: A bayesian approach for neural architecture search,” in International Conference on Machine Learning , 2019
2019
Earlier work this paper cites.
M. Cho, M. Soltani, and C. Hegde, “One-shot neural architecture search via compressive sensing,” arXiv preprint arXiv:1906.02869 , 2019
Original
2019
Earlier work this paper cites.
L. Wang, L. Xie, T. Zhang, J. Guo, and Q. Tian, “Scalable nas with factorizable architectural parameters,” arXiv preprint arXiv:1912.13256 , 2019
Original
2019
Earlier work this paper cites.
K. Bi, C. Hu, L. Xie, X. Chen, L. Wei, and Q. Tian, “Stabilizing darts with amended gradient estimation on architectural parameters,” arXiv preprint arXiv:1910.11831 , 2019
Original
2019
Earlier work this paper cites.
P. Bashivan, M. Tensen, and J. J. DiCarlo, “Teacher guided architecture search,” in International Conference on Computer Vision , 2019
2019
Earlier work this paper cites.
Y. Chen, G. Meng, Q. Zhang, S. Xiang, C. Huang, L. Mu, and X. Wang, “Renas: Reinforced evolutionary neural architecture search,” in Computer Vision and Pattern Recognition , 2019
2019
Earlier work this paper cites.
M. Guo, Z. Zhong, W. Wu, D. Lin, and J. Yan, “Irlas: Inverse reinforcement learning for architecture search,” in Computer Vision and Pattern Recognition , 2019
2019
Earlier work this paper cites.
K. A. Laube and A. Zell, “Shufflenasnets: Efficient cnn models through modified efficient neural architecture search,” in International Joint Conference on Neural Networks , 2019
2019
Earlier work this paper cites.
L. Wang, Y. Zhao, Y. Jinnai, Y. Tian, and R. Fonseca, “Alphax: exploring neural architectures with deep neural networks and monte carlo tree search,” arXiv preprint arXiv:1903.11059 , 2019
Original
2019
Earlier work this paper cites.
V. Macko, C. Weill, H. Mazzawi, and J. Gonzalvo, “Improving neural architecture search image classifiers via ensemble learning,” arXiv preprint arXiv:1903.06236 , 2019
Original
2019
Earlier work this paper cites.
M. Wistuba and T. Pedapati, “Inductive transfer for neural architecture optimization,” arXiv preprint arXiv:1903.03536 , 2019
Original
2019
Earlier work this paper cites.
Y. Chen, K. Zhu, L. Zhu, X. He, P. Ghamisi, and J. A. Benediktsson, “Automatic design of convolutional neural network for hyperspectral image classification,” IEEE Transactions on Geoscience and Remote Sensing , vol. 57, no. 9, pp. 7048–7066, 2019
2019
Earlier work this paper cites.
G. Adam and J. Lorraine, “Understanding neural architecture search techniques,” arXiv preprint arXiv:1904.00438 , 2019
Original
2019
Earlier work this paper cites.
Y. Akimoto, S. Shirakawa, N. Yoshinari, K. Uchida, S. Saito, and K. Nishida, “Adaptive stochastic natural gradient method for one-shot neural architecture search,” arXiv preprint arXiv:1905.08537 , 2019
Original
2019
Earlier work this paper cites.
C. Saltori, S. Roy, N. Sebe, and G. Iacca, “Regularized evolutionary algorithm for dynamic neural topology search,” in International Conference on Image Analysis and Processing , 2019
2019
Earlier work this paper cites.
R. Pasunuru and M. Bansal, “Continual and multi-task architecture search,” in Annual Meeting of the Association for Computational Linguistics , 2019
2019
Earlier work this paper cites.
P. Liu, B. Wu, H. Ma, P. K. Chundi, and M. Seok, “Memnet: Memory-efficiency guided neural architecture search with augment-trim learning,” arXiv preprint arXiv:1907.09569 , 2019
Original
2019
Earlier work this paper cites.

Similar

Then

K. P. Singh, D. Kim, and J. Choi, “Learning architectures for binary networks,” in European Conference on Computer Vision , 2020
2020
Closest in time.
X. Chen and C.-J. Hsieh, “Stabilizing differentiable architecture search via perturbation-based regularization,” arXiv preprint arXiv:2002.05283 , 2020
Original
2020
Closest in time.
C. He, H. Ye, L. Shen, and T. Zhang, “Milenas: Efficient neural architecture search via mixed-level reformulation,” in Computer Vision and Pattern Recognition , 2020
2020
Closest in time.
C. Liu, P. Dollár, K. He, R. Girshick, A. Yuille, and S. Xie, “Are labels necessary for neural architecture search?” in European Conference on Computer Vision , 2020
2020
Closest in time.
S. Niu, J. Wu, Y. Zhang, Y. Guo, P. Zhao, J. Huang, and M. Tan, “Disturbance-immune weight sharing for neural architecture search,” arXiv preprint arXiv:2003.13089 , 2020

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…