2018

Effects of Degradations on Deep Neural Network Architectures

Roy, Prasun, Ghosh, Subhankar, Bhattacharya, Saumik et al.

Understand

Deep convolutional neural networks (CNN) have massively influenced recent advances in large-scale image classification.

More recently, a dynamic routing algorithm with capsules (groups of neurons) has shown state-of-the-art recognition performance.
However, the behavior of such networks in the presence of a degrading signal (noise) is mostly unexplored.
An analytical study on different network architectures toward noise robustness is essential for selecting the appropriate model in a specific application scenario.

Built on

Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proceedings of the IEEE , vol. 86, no. 11, pp. 2278–2324, 1998
1998
Earlier work this paper cites.
Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing (TIP) , vol. 13, no. 4, pp. 600–612, 2004
2004
Earlier work this paper cites.
J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “ImageNet: A large-scale hierarchical image database,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2009, pp. 248–255
2009
Earlier work this paper cites.
A. Krizhevsky, G. Hinton et al. , “Learning multiple layers of features from tiny images,” 2009
2009
Earlier work this paper cites.
A. Mittal, A. K. Moorthy, and A. C. Bovik, “No-reference image quality assessment in the spatial domain,” IEEE Transactions on Image Processing (TIP) , vol. 21, no. 12, pp. 4695–4708, 2012
2012
Earlier work this paper cites.
C.-X. Ren, D.-Q. Dai, and H. Yan, “Coupled kernel embedding for low-resolution face image recognition,” IEEE Transactions on Image Processing (TIP) , vol. 21, no. 8, pp. 3770–3783, 2012
2012
Earlier work this paper cites.
W. W. Zou and P. C. Yuen, “Very low resolution face recognition problem,” IEEE Transactions on Image Processing (TIP) , vol. 21, no. 1, pp. 327–340, 2012
2012
Earlier work this paper cites.
K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556 , 2014
Original
2014
Earlier work this paper cites.

Similar

T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L. Zitnick, “Microsoft COCO: Common objects in context,” in European Conference on Computer Vision (ECCV) . Springer, 2014, pp. 740–755
2014
Cited alongside, same era.
L. J. Karam and T. Zhu, “Quality labeled faces in the wild (QLFW): A database for studying face recognition in real-world environments,” in Human Vision and Electronic Imaging XX , vol. 9394. SPIE, 2015, pp. 87–96
2015
Cited alongside, same era.
S. Ullman, L. Assif, E. Fetaya, and D. Harari, “Atoms of recognition in human and computer vision,” Proceedings of the National Academy of Sciences , vol. 113, no. 10, pp. 2744–2749, 2016
2016
Cited alongside, same era.
S. Dodge and L. Karam, “Understanding how image quality affects deep neural networks,” in The IEEE International Conference on Quality of Multimedia Experience (QoMEX) , 2016, pp. 1–6
2016
Cited alongside, same era.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2016, pp. 770–778
2016
Cited alongside, same era.
C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2016, pp. 2818–2826
2016
Cited alongside, same era.
S.-M. Moosavi-Dezfooli, A. Fawzi, and P. Frossard, “Deepfool: A simple and accurate method to fool deep neural networks,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2016, pp. 2574–2582
2016
Cited alongside, same era.

Then

J. Tao, W. Hu, and S. Wen, “Multi-source adaptation joint kernel sparse representation for visual classification,” Neural Networks , vol. 76, pp. 135–151, 2016
2016
Later among the works it cites.
A. Kurakin, I. Goodfellow, and S. Bengio, “Adversarial examples in the physical world,” arXiv preprint arXiv:1607.02533 , 2016
Original
2016
Later among the works it cites.
A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, “MobileNets: Efficient convolutional neural networks for mobile vision applications,” arXiv preprint arXiv:1704.04861 , 2017
Original
2017
Later among the works it cites.
S. Basu, M. Karki, S. Ganguly, R. DiBiano, S. Mukhopadhyay, S. Gayaka, R. Kannan, and R. Nemani, “Learning sparse feature representations using probabilistic quadtrees and deep belief nets,” Neural Processing Letters , vol. 45, no. 3, pp. 855–867, 2017
2017
Later among the works it cites.
S. Sabour, N. Frosst, and G. E. Hinton, “Dynamic routing between capsules,” in Advances in Neural Information Processing Systems (NeurIPS) , 2017, pp. 3859–3869
2017
Later among the works it cites.
J. Rauber, W. Brendel, and M. Bethge, “Foolbox: A python toolbox to benchmark the robustness of machine learning models,” arXiv preprint arXiv:1707.04131 , 2017
Original
2017
Later among the works it cites.
Y. Pei, Y. Huang, Q. Zou, H. Zang, X. Zhang, and S. Wang, “Effects of image degradations to cnn-based image classification,” arXiv preprint arXiv:1810.05552 , 2018
Original
2018
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…