2016

Hybrid CNN and Dictionary-Based Models for Scene Recognition and Domain Adaptation

Xie, Guo-Sen, Zhang, Xu-Yao, Yan, Shuicheng et al.

Understand

Convolutional neural network (CNN) has achieved state-of-the-art performance in many different visual tasks.

Learned from a large-scale training dataset, CNN features are much more discriminative and accurate than the hand-crafted features.
Moreover, CNN features are also transferable among different domains.
On the other hand, traditional dictionarybased features (such as BoW and SPM) contain much more local discriminative and structural information, which is implicitly embedded in the images.

Built on

Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proc. IEEE , vol. 86, no. 11, pp. 2278–2324, 1998
1998
Earlier work this paper cites.
D. A. Reynolds, T. F. Quatieri, and R. B. Dunn, “Speaker verification using adapted gaussian mixture models,” Digital signal processing , vol. 10, no. 1, pp. 19–41, 2000
2000
Earlier work this paper cites.
T. Kanungo, D. M. Mount, N. S. Netanyahu, C. D. Piatko, R. Silverman, and A. Y. Wu, “An efficient k-means clustering algorithm: Analysis and implementation,” TPAMI , vol. 24, no. 7, pp. 881–892, 2002
2002
Earlier work this paper cites.
F. Jurie and B. Triggs, “Creating efficient codebooks for visual recognition,” in ICCV , 2005, pp. 604–610
2005
Earlier work this paper cites.
K. M. Borgwardt, A. Gretton, M. J. Rasch, H.-P. Kriegel, B. Schölkopf, and A. J. Smola, “Integrating structured biological data by kernel maximum mean discrepancy,” Bioinformatics , vol. 22, no. 14, pp. e49–e57, 2006
2006
Earlier work this paper cites.
S. Lazebnik, C. Schmid, and J. Ponce, “Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories,” in CVPR , vol. 2. IEEE, 2006, pp. 2169–2178
2006
Earlier work this paper cites.
F. Perronnin and C. Dance, “Fisher kernels on visual vocabularies for image categorization,” in CVPR , 2007, pp. 1–8
2007
Earlier work this paper cites.
R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, “Liblinear: A library for large linear classification,” JMLR , vol. 9, pp. 1871–1874, 2008
2008
Earlier work this paper cites.
J. Yang, K. Yu, Y. Gong, and T. Huang, “Linear spatial pyramid matching using sparse coding for image classification,” in CVPR , 2009, pp. 1794–1801
2009
Earlier work this paper cites.
A. Quattoni and A. Torralba, “Recognizing indoor scenes,” in CVPR , 2009, pp. 413–420
2009
Earlier work this paper cites.
J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, “Locality-constrained linear coding for image classification,” in CVPR , 2010, pp. 3360–3367
2010
Earlier work this paper cites.
F. Perronnin, J. Sánchez, and T. Mensink, “Improving the fisher kernel for large-scale image classification,” in ECCV , 2010, pp. 143–156
2010
Earlier work this paper cites.
X. Zhou, K. Yu, T. Zhang, and T. S. Huang, “Image classification using super-vector coding of local image descriptors,” in ECCV , 2010, pp. 141–154
2010
Earlier work this paper cites.
K. Saenko, B. Kulis, M. Fritz, and T. Darrell, “Adapting visual category models to new domains,” in ECCV , 2010, pp. 213–226
2010
Earlier work this paper cites.
H. Jégou, M. Douze, C. Schmid, and P. Pérez, “Aggregating local descriptors into a compact image representation,” in CVPR , 2010, pp. 3304–3311
2010
Earlier work this paper cites.
J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba, “Sun database: Large-scale scene recognition from abbey to zoo,” in CVPR , 2010, pp. 3485–3492
2010
Earlier work this paper cites.
L.-J. Li, H. Su, L. Fei-Fei, and E. P. Xing, “Object bank: A high-level image representation for scene classification & semantic feature sparsification,” in NIPS , 2010, pp. 1378–1386
2010
Earlier work this paper cites.
K. Kavukcuoglu, P. Sermanet, Y.-L. Boureau, K. Gregor, M. Mathieu, and Y. L. Cun, “Learning convolutional feature hierarchies for visual recognition,” in NIPS , 2010, pp. 1090–1098
2010
Earlier work this paper cites.
J. Zhu, L.-J. Li, L. Fei-Fei, and E. P. Xing, “Large margin learning of upstream scene understanding models,” in NIPS , 2010, pp. 2586–2594
2010
Earlier work this paper cites.
M. Pandey and S. Lazebnik, “Scene recognition and weakly supervised object localization with deformable part-based models,” in ICCV , 2011, pp. 1307–1314
2011
Earlier work this paper cites.
R. Gopalan, R. Li, and R. Chellappa, “Domain adaptation for object recognition: An unsupervised approach,” in ICCV , 2011, pp. 999–1006
2011
Earlier work this paper cites.
Z. Jiang, Z. Lin, and L. S. Davis, “Learning a discriminative dictionary for sparse coding via label consistent k-svd,” in CVPR , 2011, pp. 1697–1704
2011
Earlier work this paper cites.
J. Wu and J. M. Rehg, “Centrist: A visual descriptor for scene categorization,” TPAMI , vol. 33, no. 8, pp. 1489–1501, 2011
2011
Earlier work this paper cites.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” in NIPS , 2012, pp. 1097–1105
2012
Earlier work this paper cites.
S. Singh, A. Gupta, and A. A. Efros, “Unsupervised discovery of mid-level discriminative patches,” in ECCV , 2012, pp. 73–86
2012
Earlier work this paper cites.
C. Doersch, S. Singh, A. Gupta, J. Sivic, and A. Efros, “What makes paris look like paris?” ACM Transactions on Graphics , vol. 31, no. 4, 2012
2012
Earlier work this paper cites.

Similar

S. N. Parizi, J. G. Oberlin, and P. F. Felzenszwalb, “Reconfigurable models for scene recognition,” in CVPR , 2012, pp. 2775–2782
2012
Cited alongside, same era.
Y. Zheng, Y.-G. Jiang, and X. Xue, “Learning hybrid part filters for scene recognition,” in ECCV , 2012, pp. 172–185
2012
Cited alongside, same era.
F. Sadeghi and M. F. Tappen, “Latent pyramidal regions for recognizing scenes,” in ECCV , 2012, pp. 228–241
2012
Cited alongside, same era.
R. Kwitt, N. Vasconcelos, and N. Rasiwasia, “Scene recognition on the semantic manifold,” in ECCV , 2012, pp. 359–372
2012
Cited alongside, same era.
Y. Su and F. Jurie, “Improving image classification using semantic attributes,” IJCV , vol. 100, no. 1, pp. 59–77, 2012
2012
Cited alongside, same era.
P. Sermanet, K. Kavukcuoglu, S. Chintala, and Y. LeCun, “Pedestrian detection with unsupervised multi-stage feature learning,” in CVPR , 2013, pp. 3626–3633
2013
Cited alongside, same era.
J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, and T. Darrell, “Decaf: A deep convolutional activation feature for generic visual recognition,” arXiv:1310.1531 , 2013
Original
2013
Cited alongside, same era.
M. Juneja, A. Vedaldi, C. Jawahar, and A. Zisserman, “Blocks that shout: Distinctive parts for scene classification,” in CVPR , 2013, pp. 923–930
2013
Cited alongside, same era.
C. Doersch, A. Gupta, and A. A. Efros, “Mid-level visual element discovery as discriminative mode seeking,” in NIPS , 2013, pp. 494–502
2013
Cited alongside, same era.
J. R. Uijlings, K. E. van de Sande, T. Gevers, and A. W. Smeulders, “Selective search for object recognition,” IJCV , vol. 104, no. 2, pp. 154–171, 2013
2013
Cited alongside, same era.
B. Gong, K. Grauman, and F. Sha, “Connecting the dots with landmarks: Discriminatively learning domain-invariant features for unsupervised domain adaptation,” in ICML , 2013, pp. 222–230
2013
Cited alongside, same era.
B. Fernando, A. Habrard, M. Sebban, and T. Tuytelaars, “Unsupervised visual domain adaptation using subspace alignment,” in ICCV , 2013, pp. 2960–2967
2013
Cited alongside, same era.

Then

J. Yosinski, J. Clune, Y. Bengio, and H. Lipson, “How transferable are features in deep neural networks?” in NIPS , 2014, pp. 3320–3328
2014
Later among the works it cites.
D. Lin, C. Lu, R. Liao, and J. Jia, “Learning important spatial pooling regions for scene classification,” in CVPR , 2014, pp. 3726–3733
2014
Later among the works it cites.
M.-M. Cheng, Z. Zhang, W.-Y. Lin, and P. Torr, “Bing: Binarized normed gradients for objectness estimation at 300fps,” in CVPR , 2014, pp. 3286–3293
2014
Later among the works it cites.
P. Arbelaez, J. Pont-Tuset, J. Barron, F. Marques, and J. Malik, “Multiscale combinatorial grouping,” in CVPR , 2014, pp. 328–335
2014
Later among the works it cites.
C. L. Zitnick and P. Dollár, “Edge boxes: Locating object proposals from edges,” in ECCV , 2014, pp. 391–405
2014
Later among the works it cites.
E. Tzeng, J. Hoffman, N. Zhang, K. Saenko, and T. Darrell, “Deep domain confusion: Maximizing for domain invariance,” arXiv:1412.3474 , 2014
Original
2014
Later among the works it cites.
M. Ghifary, W. B. Kleijn, and M. Zhang, “Domain adaptive neural networks for object recognition,” in PRICAI , 2014, pp. 898–904
2014
Later among the works it cites.
B. Liu, J. Liu, J. Wang, and H. Lu, “Learning a representative and discriminative part model with deep convolutional features for scene recognition,” in ACCV , 2014
2014
Later among the works it cites.
G.-S. Xie, X.-Y. Zhang, and C.-L. Liu, “Efficient feature coding based on auto-encoder network for image classificatio,” in ACCV , 2014
2014
Later among the works it cites.
R. Margolin, L. Zelnik-Manor, and A. Tal, “Otc: A novel local descriptor for scene classification,” in ECCV , 2014, pp. 377–391
2014
Later among the works it cites.
K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” in ICLR , 2015
2015
Later among the works it cites.
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,” in CVPR , 2015
2015
Later among the works it cites.
S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” in ICML , 2015
2015
Later among the works it cites.
K. He, X. Zhang, S. Ren, and J. Sun, “Delving deep into rectifiers: Surpassing human-level performance on imagenet classification,” arXiv:1502.01852 , 2015
Original
2015
Later among the works it cites.
W. Ouyang, P. Luo, X. Zeng, S. Qiu, Y. Tian, H. Li, S. Yang, Z. Wang, L. Chen-change, and X. Tang, “Deepid-net: multi-stage and deformable deep convolutional neural networks for object detection,” in CVPR , 2015
2015
Later among the works it cites.
J. Long, E. Shelhamer, and T. Darrell, “Fully convolutional networks for semantic segmentation,” in CVPR , 2015
2015
Later among the works it cites.
P. O. Pinheiro and R. Collobert, “From image-level to pixel-level labeling with convolutional networks,” in CVPR , 2015
2015
Later among the works it cites.
L. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, “Semantic image segmentation with deep convolutional nets and fully connected crfs,” in ICLR , 2015
2015
Later among the works it cites.
F. Zhao, Y. Huang, L. Wang, and T. Tan, “Deep semantic ranking based hashing for multi-label image retrieval,” in CVPR , 2015
2015
Later among the works it cites.
M. Cimpoi, S. Maji, and A. Vedaldi, “Deep convolutional filter banks for texture recognition and segmentation,” in CVPR , 2015
2015
Later among the works it cites.
L. Mingsheng, Y. Cao, J. Wang, and M. Jordan, “Learning transferable features with deep adaptation networks,” 2015
2015
Later among the works it cites.
D. Yoo, S. Park, J.-Y. Lee, and I. S. Kweon, “Fisher kernel for deep neural activations,” in CVPRW , 2015
2015
Later among the works it cites.
L. Wang, S. Guo, W. Huang, and Y. Qiao, “Places205-vggnet models for scene recognition,” arXiv:1508.01667 , 2015
Original
2015
Later among the works it cites.
C. Xu, C. Lu, J. Gao, W. Zheng, T. Wang, and S. Yan, “Discriminative analysis for symmetric positive definite matrices on lie groups,” IEEE Transactions on Circuits and Systems for Video Technology , 2015
2015
Later among the works it cites.
B. Gong, Y. Shi, F. Sha, and K. Grauman, “Geodesic flow kernel for unsupervised domain adaptation,” in CVPR , 2012, pp. 2066–2073
2073
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…