Fetching the paper…
Reading the bibliography…
Deploying deep learning models in time-critical applications with limited computational resources, for instance in edge computing systems and IoT networks, is a challenging task that often relies on dynamic inference methods such as early exiting.
1906
Earlier work this paper cites.
N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, R. Salakhutdinov, Dropout: A simple way to prevent neural networks from overfitting, J. Mach. Learn. Res. 15 (1) (2014) 1929–1958
1958
Earlier work this paper cites.
doi:10.1109/tsa.2002.800560
G. Tzanetakis, P. Cook, Musical genre classification of audio signals , IEEE Transactions on Speech and Audio Processing 10 (5) (2002) 293–302 · 2002
Earlier work this paper cites.
2003
Earlier work this paper cites.
2003
Earlier work this paper cites.
2005
Earlier work this paper cites.
2007
Earlier work this paper cites.
doi:10.1109/cvpr.2009.5206848
J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, L. Fei-Fei, ImageNet: A large-scale hierarchical image database , in: 2009 IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2009 · 2009
Earlier work this paper cites.
2011
Earlier work this paper cites.
2012
Earlier work this paper cites.
doi:10.1038/nature14539
Y. LeCun, Y. Bengio, G. Hinton, Deep learning , Nature 521 (7553) (2015) 436–444 · 2015
Earlier work this paper cites.
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, A. Rabinovich, Going deeper with convolutions, in: Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 1–9
2015
Earlier work this paper cites.
doi:10.1109/cvpr.2015.7298684
C. Zhang, H. Li, X. Wang, X. Yang, Cross-scene crowd counting via deep convolutional neural networks , in: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2015 · 2015
Earlier work this paper cites.
2015
Earlier work this paper cites.
S. Ioffe, C. Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift , in: F. Bach, D. Blei (Eds.), Proceedings of the 32nd International Conference on Machine Learning, Vol. 37 of Proceedings of Machine Learning Research, PMLR, Lille, France, 2015, pp. 448–456. URL http://proceedings.mlr.press/v37/ioffe15.html
2015
Earlier work this paper cites.
2015
Earlier work this paper cites.
K. He, X. Zhang, S. Ren, J. Sun, Delving deep into rectifiers: Surpassing human-level performance on imagenet classification, in: Proceedings of the IEEE international conference on computer vision, 2015, pp. 1026–1034
2015
Earlier work this paper cites.
doi:10.1007/978-3-319-46493-0_32
M. Rastegari, V. Ordonez, J. Redmon, A. Farhadi, XNOR-net: ImageNet classification using binary convolutional neural networks , in: Computer Vision – ECCV 2016, Springer International Publishing, 2016, pp. 525–542 · 2016
Earlier work this paper cites.
doi:10.1109/icpr.2016.7900006
S. Teerapittayanon, B. McDanel, H. Kung, BranchyNet: Fast inference via early exiting from deep neural networks , in: 2016 23rd International Conference on Pattern Recognition (ICPR), IEEE, 2016 · 2016
Cited alongside, same era.
A. Graves, Adaptive computation time for recurrent neural networks, arXiv:1603.08983 (2016)
2016
Cited alongside, same era.
doi:10.1109/cvpr.2016.90
K. He, X. Zhang, S. Ren, J. Sun, Deep residual learning for image recognition , in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2016 · 2016
Cited alongside, same era.
doi:10.1109/cvpr.2016.308
C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, Z. Wojna, Rethinking the inception architecture for computer vision , in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2016 · 2016
Cited alongside, same era.
doi:10.1109/cvpr.2016.70
Y. Zhang, D. Zhou, S. Chen, S. Gao, Y. Ma, Single-image crowd counting via multi-column convolutional neural network , in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2016 · 2016
Cited alongside, same era.
L. Zhang, J. Song, A. Gao, J. Chen, C. Bao, K. Ma, Be your own teacher: Improve the performance of convolutional neural networks via self distillation, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 3713–3722
2019
Later among the works it cites.
Z. Jie, P. Sun, X. Li, J. Feng, W. Liu, Anytime recognition with routing convolutional networks, IEEE transactions on pattern analysis and machine intelligence 43 (6) (2019) 1875–1886
2019
Later among the works it cites.
X. Gao, Y. Zhao, L. Dudziak, R. D. Mullins, C. Xu, Dynamic channel pruning: Feature boosting and suppression , in: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019, OpenReview.net, 2019. URL https://openreview.net/forum?id=BJxh2j0qYm
2019
Later among the works it cites.
doi:10.21105/joss.00747
A. LeNail, NN-SVG: Publication-ready neural network architecture schematics , Journal of Open Source Software 4 (33) (2019) 747 · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
doi:10.1109/msp.2017.2765695
Y. Cheng, D. Wang, P. Zhou, T. Zhang, Model compression and acceleration for deep neural networks: The principles, progress, and challenges , IEEE Signal Processing Magazine 35 (1) (2018) 126–136 · 2017
Cited alongside, same era.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. u. Kaiser, I. Polosukhin, Attention is all you need , in: I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, R. Garnett (Eds.), Advances in Neural Information Processing Systems, Vol. 30, Curran Associates, Inc., 2017. URL https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
2017
Cited alongside, same era.
doi:10.1109/cvpr.2017.243
G. Huang, Z. Liu, L. V. D. Maaten, K. Q. Weinberger, Densely connected convolutional networks , in: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2017 · 2017
Cited alongside, same era.
doi:10.1016/j.patrec.2017.07.007
V. A. Sindagi, V. M. Patel, A survey of recent advances in CNN-based single image crowd counting and density estimation , Pattern Recognition Letters 107 (2018) 3–16 · 2017
Cited alongside, same era.
doi:10.1109/icassp.2017.7952132
S. Hershey, S. Chaudhuri, D. P. W. Ellis, J. F. Gemmeke, A. Jansen, R. C. Moore, M. Plakal, D. Platt, R. A. Saurous, B. Seybold, M. Slaney, R. J. Weiss, K. Wilson, CNN architectures for large-scale audio classification , in: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, 2017 · 2017
Cited alongside, same era.
doi:10.1109/CVPR.2017.660
H. Zhao, J. Shi, X. Qi, X. Wang, J. Jia, Pyramid scene parsing network, in: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 6230–6239 · 2017
Cited alongside, same era.
doi:10.1109/TPAMI.2017.2699184
L. Chen, G. Papandreou, I. Kokkinos, K. Murphy, A. L. Yuille, Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs, IEEE Transactions on Pattern Analysis & Machine Intelligence 40 (04) (2018) 834–848 · 2017
Cited alongside, same era.
doi:10.23915/distill.00021
A. Araujo, W. Norris, J. Sim, Computing receptive fields of convolutional neural networks, DistillHttps://distill.pub/2019/computing-receptive-fields (2019) · 2019
Later among the works it cites.
I. Loshchilov, F. Hutter, Decoupled weight decay regularization , in: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019, OpenReview.net, 2019. URL https://openreview.net/forum?id=Bkg6RiCqY7
2019
Later among the works it cites.
doi:10.1109/comst.2020.2970550
X. Wang, Y. Han, V. C. M. Leung, D. Niyato, X. Yan, X. Chen, Convergence of edge computing and deep learning: A comprehensive survey , IEEE Communications Surveys & Tutorials 22 (2) (2020) 869–904 · 2020
Later among the works it cites.
doi:10.1007/s12559-020-09734-4
S. Scardapane, M. Scarpiniti, E. Baccarelli, A. Uncini, Why should we add early exits to neural networks? , Cognitive Computation 12 (5) (2020) 954–966 · 2020
Later among the works it cites.
doi:10.1016/j.ins.2020.02.041
E. Baccarelli, S. Scardapane, M. Scarpiniti, A. Momenzadeh, A. Uncini, Optimized training and scalable implementation of conditional deep neural networks with early exits for fog-supported IoT applications , Information Sciences 521 (2020) 107–143 · 2020
Later among the works it cites.
M. Elbayad, J. Gu, E. Grave, M. Auli, Depth-adaptive transformer , in: International Conference on Learning Representations, 2020. URL https://openreview.net/forum?id=SJg7KhVKPH
2020
Later among the works it cites.
T. Hu, T. Chen, H. Wang, Z. Wang, Triple wins: Boosting accuracy, robustness and efficiency together by enabling input-adaptive inference, in: ICLR, 2020
2020
Later among the works it cites.
doi:10.1109/IJCNN52387.2021.9533875
A. Bakhtiarnia, Q. Zhang, A. Iosifidis, Improving the accuracy of early exits in multi-exit architectures via curriculum learning, in: 2021 International Joint Conference on Neural Networks (IJCNN), 2021, pp. 1–8 · 2021
Closest in time.
A. Bakhtiarnia, Q. Zhang, A. Iosifidis, Multi-exit vision transformer for dynamic inference, The 32nd British Machine Vision Conference (BMVC 2021) (2021)
2021
Closest in time.
A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, J. Uszkoreit, N. Houlsby, An image is worth 16x16 words: Transformers for image recognition at scale , in: International Conference on Learning Representations, 2021. URL https://openreview.net/forum?id=YicbFdNTTy
2021
Closest in time.
M. Wołczyk, B. Wójcik, K. Bałazy, I. Podolak, J. Tabor, M. Śmieja, T. Trzcinski, Zero time waste: Recycling predictions in early exit neural networks, Advances in Neural Information Processing Systems 34 (2021)
2021
Closest in time.
J. Pomponi, S. Scardapane, A. Uncini, A probabilistic re-intepretation of confidence scores in multi-exit models, Entropy 24 (1) (2021) 1
2021
Closest in time.
H. Lee, C.-J. Hsieh, J.-S. Lee, Local critic training for model-parallel learning of deep neural networks, IEEE Transactions on Neural Networks and Learning Systems (2021)
2021
Closest in time.