Fetching the paper…
Reading the bibliography…
We formalize and analyze a fundamental component of differentiable neural architecture search (NAS): local "operation scoring" at each operation choice.
Neural Predictor for Neural Architecture Search
Wen, W.; Liu, H.; Li, H.; Chen, Y.; Bender, G.; and Kindermans, P.-J. 2019 · 1912
Earlier work this paper cites.
Dynamic Programming
Bellman, R. 1957 · 1957
Earlier work this paper cites.
Fast Exact Multiplication by the Hessian
Pearlmutter, B. A. 1993 · 1993
Earlier work this paper cites.
Nas-bench-1shot1: Benchmarking and dissecting one-shot neural architecture search
Zela, A.; Siems, J.; and Hutter, F. 2020 · 2001
Earlier work this paper cites.
NPENAS: Neural Predictor Guided Evolution for Neural Architecture Search
Wei, C.; Niu, C.; Tang, Y.; and min Liang, J. 2020 · 2003
Earlier work this paper cites.
ImageNet: A Large-Scale Hierarchical Image Database
Deng, J.; Dong, W.; Socher, R.; Li, L.-J.; Li, K.; and Fei-Fei, L. 2009 · 2009
Earlier work this paper cites.
Neural Architecture Search with Reinforcement Learning
Zoph, B.; and Le, Q. V. 2017 · 2017
Earlier work this paper cites.
Neural Architecture Optimization
Luo, R.; Tian, F.; Qin, T.; Chen, E.; and Liu, T.-Y. 2018 · 2018
Earlier work this paper cites.
Efficient Neural Architecture Search via Parameters Sharing
Pham, H.; Guan, M.; Zoph, B.; Le, Q.; and Dean, J. 2018 · 2018
Earlier work this paper cites.
Faster gaze prediction with dense networks and Fisher pruning
Theis, L.; Korshunova, I.; Tejani, A.; and Huszár, F. 2018 · 2018
Earlier work this paper cites.
ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
Cai, H.; Zhu, L.; and Han, S. 2019 · 2019
Earlier work this paper cites.
Single Path One-Shot Neural Architecture Search with Uniform Sampling
Guo, Z.; Zhang, X.; Mu, H.; Heng, W.; Liu, Z.; Wei, Y.; and Sun, J. 2019 · 2019
Earlier work this paper cites.
Searching for MobileNetV3
Howard, A.; Sandler, M.; Chu, G.; Chen, L.-C.; Chen, B.; Tan, M.; Wang, W.; Zhu, Y.; Pang, R.; Vasudevan, V.; Le, Q. V.; and Adam, H. 2019 · 2019
Earlier work this paper cites.
SNIP: Single-shot network pruning based on connection sensitivity
Lee, N.; Ajanthan, T.; and Torr, P. H. 2019 · 2019
Cited alongside, same era.
DARTS: Differentiable Architecture Search
Liu, H.; Simonyan, K.; and Yang, Y. 2019 · 2019
Cited alongside, same era.
Regularized Evolution for Image Classifier Architecture Search
Real, E.; Aggarwal, A.; Huang, Y.; and Le, Q. V. 2019 · 2019
Cited alongside, same era.
Stabilizing differentiable architecture search via perturbation-based regularization
Chen, X.; and Hsieh, C.-J. 2020 · 2020
Cited alongside, same era.
NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search
Dong, X.; and Yang, Y. 2020 · 2020
Cited alongside, same era.
BRP-NAS: Prediction-based NAS using GCNs
Dudziak, Ł.; Chau, T.; Abdelfattah, M. S.; Lee, R.; Kim, H.; and Lane, N. D. 2020 · 2020
Cited alongside, same era.
Evaluating The Search Phase of Neural Architecture Search
Yu, K.; Sciuto, C.; Jaggi, M.; and Claudiu Musat, M. S. 2020 · 2020
Later among the works it cites.
Understanding and robustifying differentiable architecture search
Zela, A.; Elsken, T.; Saikia, T.; Marrakchi, Y.; Brox, T.; and Hutter, F. 2020 · 2020
Later among the works it cites.
EcoNAS: Finding Proxies for Economical Neural Architecture Search
Zhou, D.; Zhou, X.; Zhang, W.; Loy, C. C.; Yi, S.; Zhang, X.; and Ouyang, W. 2020 · 2020
Later among the works it cites.
Zero-Cost Proxies for Lightweight NAS
Abdelfattah, M. S.; Mehrotra, A.; Dudziak, Ł.; and Lane, N. D. 2021 · 2021
Closest in time.
Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective
Chen, W.; Gong, X.; and Wang, Z. 2021 · 2021
Closest in time.
Neural Tangent Kernel: Convergence and Generalization in Neural Networks (Invited Paper)
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
SGAS: Sequential greedy architecture search
Li, G.; Qian, G.; Delgadillo, I. C.; Muller, M.; Thabet, A.; and Ghanem, B. 2020 · 2020
Cited alongside, same era.
Understanding Architectures Learnt by Cell-based Neural Architecture Search
Shu, Y.; Wang, W.; and Cai, S. 2020 · 2020
Cited alongside, same era.
Pruning neural networks without any data by iteratively conserving synaptic flow
Tanaka, H.; Kunin, D.; Yamins, D. L. K.; and Ganguli, S. 2020 · 2020
Cited alongside, same era.
BlockSwap: Fisher-guided Block Substitution for Network Compression on a Budget
Turner, J.; Crowley, E. J.; O’Boyle, M.; Storkey, A.; and Gray, G. 2020 · 2020
Cited alongside, same era.
Picking Winning Tickets Before Training by Preserving Gradient Flow
Wang, C.; Zhang, G.; and Grosse, R. 2020 · 2020
Cited alongside, same era.
PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search
Xu, Y.; Xie, L.; Zhang, X.; Chen, X.; Qi, G.-J.; Tian, Q.; and Xiong, H. 2020 · 2020
Cited alongside, same era.
Jacot, A.; Gabriel, F.; and Hongler, C. 2021 · 2021
Closest in time.
Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition
Lin, M.; Wang, P.; Sun, Z.; Chen, H.; Sun, X.; Qian, Q.; Li, H.; and Jin, R. 2021 · 2021
Closest in time.
NAS-Bench-ASR: Reproducible Neural Architecture Search for Speech Recognition
Mehrotra, A.; Ramos, A. G.; Bhattacharya, S.; Łukasz Dudziak; Vipperla, R.; Chau, T.; Abdelfattah, M. S.; Ishtiaq, S.; and Lane, N. D. 2021 · 2021
Closest in time.
Neural Architecture Search without Training
Mellor, J.; Turner, J.; Storkey, A.; and Crowley, E. J. 2021 · 2021
Closest in time.
Prioritized Architecture Sampling with Monto-Carlo Tree Search
Su, X.; Huang, T.; Li, Y.; You, S.; Wang, F.; Qian, C.; Zhang, C.; and Xu, C. 2021 · 2021
Closest in time.
Rethinking Architecture Selection in Differentiable NAS
Wang, R.; Cheng, M.; Chen, X.; Tang, X.; and Hsieh, C.-J. 2021 · 2021
Closest in time.
Weak NAS Predictors Are All You Need
Wu, J.; Dai, X.; Chen, D.; Chen, Y.; Liu, M.; Yu, Y.; Wang, Z.; Liu, Z.; Chen, M.; and Yuan, L. 2021 · 2021
Closest in time.