Fetching the paper…
Reading the bibliography…
High storage and computational costs obstruct deep neural networks to be deployed on resource-constrained devices.
D. Pechyony and V. Vapnik, “On the theory of learnining with privileged information,” in Advances in neural information processing systems , 2010, pp. 1894–1902
1902
Earlier work this paper cites.
Y. L. Cun, J. S. Denker, and S. A. Solla, “Optimal brain damage,” in International Conference on Neural Information Processing Systems , 1989, pp. 598–605
1989
Earlier work this paper cites.
B. Hassibi and D. G. Stork, “Second order derivatives for network pruning: Optimal brain surgeon,” Advances in Neural Information Processing Systems , vol. 5, pp. 164–171, 1993
1993
Earlier work this paper cites.
C. Buciluǎ, R. Caruana, and A. Niculescu-Mizil, “Model compression,” in Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , 2006, pp. 535–541
2006
Earlier work this paper cites.
K. Q. Weinberger, A. Dasgupta, J. Langford, A. J. Smola, and J. Attenberg, “Feature hashing for large scale multitask learning,” in Proceedings of the 26th Annual International Conference on Machine Learning, ICML 2009, Montreal, Quebec, Canada, June 14-18, 2009 , 2009, pp. 1113–1120
2009
Earlier work this paper cites.
V. Vapnik and A. Vashist, “A new learning paradigm: Learning using privileged information,” Neural networks , vol. 22, no. 5-6, pp. 544–557, 2009
2009
Earlier work this paper cites.
A. Krizhevsky and G. Hinton, “Learning multiple layers of features from tiny images,” Tech. Rep., 2009
2009
Earlier work this paper cites.
F. Perronnin, J. S. aacute;nchez, and T. Mensink, “Improving the fisher kernel for large-scale image classification,” in European Conference on Computer Vision (ECCV) , 2010
2010
Earlier work this paper cites.
Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu, and A. Y. Ng, “Reading digits in natural images with unsupervised feature learning,” In NIPS workshop on deep learning and unsupervised feature learning , 2011
2011
Earlier work this paper cites.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” Advances in neural information processing systems , pp. 1097–1105, 2012
2012
Earlier work this paper cites.
Q. Wang, Y. Yuan, P. Yan, and X. Li, “Saliency detection by multiple-instance learning,” IEEE Transactions on Cybernetics , vol. 43, pp. 660–672, 2013
2013
Earlier work this paper cites.
M. Denil, B. Shakibi, L. Dinh, M. Ranzato, and N. D. Freitas, “Predicting parameters in deep learning,” in International Conference on Neural Information Processing Systems , 2013, pp. 2148–2156
2013
Earlier work this paper cites.
J. B. Lei and R. Caruana, “Do deep nets really need to be deep?” Advances in Neural Information Processing Systems , pp. 2654–2662, 2013
2013
Earlier work this paper cites.
G. Zhu, Q. Wang, and Y. Yuan, “Natas: Neural activity trace aware saliency,” IEEE Transactions on Cybernetics , pp. 1014–1024, 2014
2014
Earlier work this paper cites.
M. Jaderberg, A. Vedaldi, and A. Zisserman, “Speeding up convolutional neural networks with low rank expansions,” Computer Science , vol. 4, no. 4, p. XIII, 2014
2014
Earlier work this paper cites.
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , June 2015, pp. 1–9
2015
Earlier work this paper cites.
S. Antol, A. Agrawal, J. Lu, M. Mitchell, D. Batra, C. Lawrence Zitnick, and D. Parikh, “Vqa: Visual question answering,” in 2015 IEEE International Conference on Computer Vision , December 2015, pp. 2425–2433
2015
Earlier work this paper cites.
H. Song, H. Mao, and W. J. Dally, “Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding,” Fiber , pp. 3–7, 2015
2015
Earlier work this paper cites.
S. Han, J. Pool, J. Tran, and W. J. Dally, “Learning both weights and connections for efficient neural networks,” Advances in neural information processing systems. , pp. 1135–1143, 2015
2015
Earlier work this paper cites.
G. Hinton, O. Vinyals, and J. Dean, “Distilling the knowledge in a neural network,” Computer Science , vol. 14, no. 7, pp. 38–39, 2015
2015
Earlier work this paper cites.
A. Romero, N. Ballas, S. E. Kahou, A. Chassang, and Y. Bengio, “Fitnets: Hints for thin deep nets,” Computer Science , 2015
2015
Earlier work this paper cites.
O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, and M. Bernstein, “Imagenet large scale visual recognition challenge,” International Journal of Computer Vision , pp. 211–252, 2015
2015
Earlier work this paper cites.
Y. Yuan, J. Fang, and Q. Wang, “Online anomaly detection in crowd scenes via structure analysis,” IEEE Transactions on Cybernetics , pp. 548–561, 2015
2015
Earlier work this paper cites.
K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings , 2015
2015
Earlier work this paper cites.
W. Chen, J. T. Wilson, S. Tyree, K. Q. Weinberger, and Y. Chen, “Compressing neural networks with the hashing trick,” Proceedings of the 32nd International Conference on Machine Learning, ICML 2015, Lille, France, 6-11 July 2015 , pp. 2285–2294
2015
Earlier work this paper cites.
X. Zhang, J. Zou, X. Ming, K. He, and J. Sun, “Efficient and accurate approximations of nonlinear convolutional networks,” IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA, June 7-12, 2015 , pp. 1984–1992, 2015
2015
Earlier work this paper cites.
Y. D. Kim, E. Park, S. Yoo, T. Choi, Y. Lu, and D. Shin, “Compression of deep convolutional neural networks for fast and low power mobile applications,” Computer Science , vol. 71, no. 2, pp. 576–584, 2015
2015
Earlier work this paper cites.
V. Vapnik and R. Izmailov, “Learning using privileged information: similarity control and knowledge transfer.” Journal of machine learning research , vol. 16, no. 2023-2049, p. 2, 2015
2015
Cited alongside, same era.
D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings , 2015
2015
Cited alongside, same era.
Y. Le and X. Yang, “Tiny imagenet visual recognition challenge,” Stanford Class CS 231N , 2015
2015
Cited alongside, same era.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , June 2016, pp. 770–778
2016
Cited alongside, same era.
J. Yim, D. Joo, J. Bae, and J. Kim, “A gift from knowledge distillation: Fast optimization, network minimization and transfer learning,” in IEEE Conference on Computer Vision and Pattern Recognition , 2017, pp. 7130–7138
2017
Later among the works it cites.
2017
Later among the works it cites.
Q. Li, S. Jin, and J. Yan, “Mimicking very efficient network for object detection,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , July 2017
2017
Later among the works it cites.
Y. Shan, X. Chang, X. Chao, and D. Tao, “Learning from multiple teacher networks,” in Acm Sigkdd International Conference on Knowledge Discovery and Data Mining , 2017, pp. 1285–1294
2017
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
H. Noh, P. Hongsuck Seo, and B. Han, “Image question answering using convolutional neural network with dynamic parameter prediction,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , June 2016, pp. 30–38
2016
Cited alongside, same era.
2016
Cited alongside, same era.
Y. Yuan, J. Lin, and Q. Wang, “Hyperspectral image classification via multitask joint sparse representation and stepwise mrf optimization,” IEEE Transactions on Cybernetics , pp. 2966–2977, 2016
2016
Cited alongside, same era.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 770–778
2016
Cited alongside, same era.
Y. Yuan, D. Ma, and Q. Wang, “Hyperspectral anomaly detection by graph pixel selection,” IEEE Transactions on Cybernetics , vol. 46, pp. 3123–3134, 2016
2016
Cited alongside, same era.
G. Urban, K. J. Geras, S. E. Kahou, O. Aslan, S. Wang, R. Caruana, A. Mohamed, M. Philipose, and M. Richardson, “Do deep convolutional nets really need to be deep (or even convolutional)?” Nature , vol. 521, 2016
2016
Cited alongside, same era.
I. Bello, B. Zoph, V. Vasudevan, and Q. V. Le, “Neural optimizer search with reinforcement learning,” Proceedings of the 34th International Conference on Machine Learning , pp. 459–468, 2016
2016
Cited alongside, same era.
B. Baker, O. Gupta, N. Naik, and R. Raskar, “Designing neural network architectures using reinforcement learning,” 5th International Conference on Learning Representations, ICLR , 2016
2016
Cited alongside, same era.
R. R. Selvaraju, A. Das, R. Vedantam, M. Cogswell, D. Parikh, and D. Batra, “Grad-cam: Why did you say that? visual explanations from deep networks via gradient-based localization,” 2017 IEEE International Conference on Computer Vision (ICCV) , pp. 618–626, 2017
2017
Later among the works it cites.
X. Zhang, X. Zhou, M. Lin, and S. Jian, “Shufflenet: An extremely efficient convolutional neural network for mobile devices,” 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018 , pp. 6848–6856
2018
Later among the works it cites.
G. Huang, S. Liu, L. van der Maaten, and K. Q. Weinberger, “Condensenet: An efficient densenet using learned group convolutions,” in 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018 , 2018, pp. 2752–2761
2018
Later among the works it cites.
L. Wang, H. Lu, and M. Yang, “Constrained superpixel tracking,” IEEE Transactions on Cybernetics , vol. 48, no. 3, pp. 1030–1041, 2018
2018
Later among the works it cites.
C. Liu, B. Zoph, M. Neumann, J. Shlens, W. Hua, L.-J. Li, L. Fei-Fei, A. Yuille, J. Huang, and K. Murphy, “Progressive neural architecture search,” in Proceedings of the European Conference on Computer Vision (ECCV) , 2018, pp. 19–34
2018
Later among the works it cites.
Y. Wang, C. Xu, C. Xu, and D. Tao, “Adversarial learning of portable student networks,” in Thirty-Second AAAI Conference on Artificial Intelligence , 2018
2018
Later among the works it cites.
L. Dong, L. He, M. Mao, G. Kong, X. Wu, Q. Zhang, X. Cao, and E. Izquierdo, “Cunet: A compact unsupervised network for image classification,” IEEE Trans. Multimedia , vol. 20, no. 8, pp. 2012–2021, 2018
2018
Later among the works it cites.
W. Ren, J. Zhang, L. Ma, J. Pan, X. Cao, W. Zuo, W. Liu, and M. Yang, “Deep non-blind deconvolution via generalized low-rank approximation,” in Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018 , 2018, pp. 295–305
2018
Later among the works it cites.
A. Polino, R. Pascanu, and D. Alistarh, “Model compression via distillation and quantization,” 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings , 2018
2018
Later among the works it cites.
Z. Xu, Y.-C. Hsu, and J. Huang, “Training shallow and thin networks for acceleration via knowledge distillation with conditional adversarial networks,” 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Workshop Track Proceedings , 2018
2018
Later among the works it cites.
2018
Later among the works it cites.
T. Furlanello, Z. C. Lipton, M. Tschannen, L. Itti, and A. Anandkumar, “Born again neural networks,” Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsmässan, Stockholm, Sweden, July 10-15, 2018 , pp. 1602–1611, 2018
2018
Later among the works it cites.
Y. Chen, N. Wang, and Z. Zhang, “Darkrank: Accelerating deep metric learning via cross sample similarities transfer,” in Thirty-Second AAAI Conference on Artificial Intelligence , 2018
2018
Later among the works it cites.
J. Xie, B. Shuai, J.-F. Hu, J. Lin, and W.-S. Zheng, “Improving fast segmentation with teacher-student learning,” British Machine Vision Conference 2018, BMVC 2018, Northumbria University, Newcastle, UK, September 3-6, 2018 , p. 205, 2018
2018
Later among the works it cites.
Y. Zhang, T. Xiang, T. M. Hospedales, and H. Lu, “Deep mutual learning,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2018, pp. 4320–4328
2018
Later among the works it cites.
Z. Xu, Y. Hsu, and J. Huang, “Training shallow and thin networks for acceleration via knowledge distillation with conditional adversarial networks,” International Conference on Learning Representations Workshop , 2018
2018
Later among the works it cites.
J. Gao, Q. Wang, and X. Li, “Pcc net: Perspective crowd counting via spatial convolutional network,” IEEE Transactions on Circuits and Systems for Video Technology , 2019
2019
Closest in time.
S. Lin, R. Ji, C. Yan, B. Zhang, L. Cao, Q. Ye, F. Huang, and D. Doermann, “Towards optimal structured cnn pruning via generative adversarial learning,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2019, pp. 2790–2799
2019
Closest in time.
J. Wang, W. Bao, L. Sun, X. Zhu, B. Cao, and P. S. Yu, “Private model compression via knowledge distillation,” Association for the Advancement of Artificial Intelligence , 2019
2019
Closest in time.
S. Lin, R. Ji, Y. Li, C. Deng, and X. Li, “Towards compact convnets via structure-sparsity regularized filter pruning,” IEEE transactions on neural networks and learning systems , 2019
2019
Closest in time.
S. Lin, J. Zeng, and X. Zhang, “Constructive neural network learning,” IEEE Transactions on Cybernetics , vol. 49, no. 1, pp. 221–232, Jan 2019
2019
Closest in time.
C. Shen, X. Wang, J. Song, L. Sun, and M. Song, “Amalgamating knowledge towards comprehensive classification,” The Thirty-Third AAAI Conference on Artificial Intelligence , 2019
2019
Closest in time.
G. Zhou, Y. Fan, R. Cui, W. Bian, X. Zhu, and G. Kun, “Rocket launching: A unified and effecient framework for training well-behaved light net,” The Thirty-Second AAAI Conference on Artificial Intelligence , 2019
2019
Closest in time.