Fetching the paper…
Reading the bibliography…
Current state-of-the-art deep neural networks for image classification are made up of 10 - 100 million learnable weights and are therefore inherently prone to overfitting.
Gradient-based learning applied to document recognition
Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner · 1998
Earlier work this paper cites.
Multigrid
U. Trottenberg, C. W. Oosterlee, and A. Schüller · 2001
Earlier work this paper cites.
Learning Multiple Layers of Features from Tiny Images
A. Krizhevsky · 2009
Earlier work this paper cites.
MGIC: Multigrid-in-Channels Neural Network Architectures
M. Eliasof, J. Ephrath, L. Ruthotto, and E. Treister · 2011
Earlier work this paper cites.
On-the-Fly Adaptive Smoothed Aggregation Multigrid for Markov Chains
E. Treister and I. Yavneh · 2011
Earlier work this paper cites.
ImageNet Classification with Deep Convolutional Neural Networks
A. Krizhevsky, I. Sutskever, and G. E. Hinton · 2012
Earlier work this paper cites.
Understanding machine learning: from theory to algorithms
S. Shalev-Shwartz and S. Ben-David · 2014
Earlier work this paper cites.
Learning both Weights and Connections for Efficient Neural Network
S. Han, J. Pool, J. Tran, and W. Dally · 2015
Earlier work this paper cites.
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
K. He, X. Zhang, S. Ren, and J. Sun · 2015
Earlier work this paper cites.
ImageNet Large Scale Visual Recognition Challenge
O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei · 2015
Earlier work this paper cites.
Deep Residual Learning for Image Recognition
K. He, X. Zhang, S. Ren, and J. Sun · 2016
Cited alongside, same era.
Pruning Filters for Efficient ConvNets
H. Li, A. Kadav, I. Durdanovic, H. Samet, and H. Graf · 2016
Cited alongside, same era.
Pruning Convolutional Neural Networks for Resource Efficient Transfer Learning
P. Molchanov, S. Tyree, T. Karras, T. Aila, and J. Kautz · 2016
Cited alongside, same era.
The Power of Sparsity in Convolutional Neural Networks
S. Changpinyo, M. Sandler, and A. Zhmoginov · 2017
Cited alongside, same era.
DSD: Dense-Sparse-Dense Training for Deep Neural Networks
S. Han, J. Pool, S. Narang, H. Mao, E. Gong, S. Tang, E. Elsen, P. Vajda, M. Paluri, J. Tran, B. Catanzaro, and W. Dally · 2017
Cited alongside, same era.
Aggregated Residual Transformations for Deep Neural Networks
S. Xie, R. Girshick, P. Dollar, Z. Tu, and K. He · 2017
Later among the works it cites.
Learning the Number of Neurons in Deep Networks
J. M. Alvarez and M. Salzmann · 2018
Later among the works it cites.
MorphNet: Fast & Simple Resource-Constrained Structure Learning of Deep Networks
A. Gordon, E. Eban, O. Nachum, B. Chen, H. Wu, T.-J. Yang, and E. Choi · 2018
Later among the works it cites.
Adaptive Algebraic Multigrid for Lattice QCD Computations
K. Kahl · 2018
Later among the works it cites.
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
X. Zhang, X. Zhou, M. Lin, and J. Sun · 2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Y. He, X. Zhang, and J. Sun · 2017
Cited alongside, same era.
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam · 2017
Cited alongside, same era.
Multigrid Neural Architectures
T.-W. Ke, M. Maire, and S. Yu · 2017
Cited alongside, same era.
SGDR: Stochastic Gradient Descent with Warm Restarts, May 2017
I. Loshchilov and F. Hutter · 2017
Cited alongside, same era.
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms, Sept. 2017
H. Xiao, K. Rasul, and R. Vollgraf · 2017
Cited alongside, same era.
Second Order Derivatives for Network Pruning: Optimal Brain Surgeon
B. Hassibi and D. G. Stork
Cited in the paper.
Identity Mappings in Deep Residual Networks
K. He, X. Zhang, S. Ren, and J. Sun
Cited in the paper.
MgNet: A unified framework of multigrid and convolutional neural network
J. He and J. Xu · 2019
Later among the works it cites.
Searching for MobileNetV3
A. Howard, M. Sandler, B. Chen, W. Wang, L.-C. Chen, M. Tan, G. Chu, V. Vasudevan, Y. Zhu, R. Pang, H. Adam, and Q. Le · 2019
Later among the works it cites.
PyTorch: An Imperative Style, High-Performance Deep Learning Library
A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga, A. Desmaison, A. Kopf, E. Yang, Z. DeVito, M. Raison, A. Tejani, S. Chilamkurthy, B. Steiner, L. Fang, J. Bai, and S. Chintala · 2019
Later among the works it cites.
MobileNetV2: Inverted Residuals and Linear Bottlenecks
M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L.-C. Chen · 2019
Later among the works it cites.
An Interpretive Constrained Linear Model for ResNet and MgNet
J. He, J. Xu, L. Zhang, and J. Zhu · 2021
Later among the works it cites.