2019

GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond

Cao, Yue, Xu, Jiarui, Lin, Stephen et al.

Understand

The Non-Local Network (NLNet) presents a pioneering approach for capturing long-range dependencies, via aggregating query-specific global context to each query position.

However, through a rigorous empirical analysis, we have found that the global contexts modeled by non-local network are almost the same for different query positions within an image.
In this paper, we take advantage of this finding to create a simplified network based on a query-independent formulation, which maintains the accuracy of NLNet but with significantly less computation.
We further observe that this simplified design shares similar structure with Squeeze-Excitation Network (SENet).

Built on

Imagenet: A large-scale hierarchical image database
J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei · 2009
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
A. Krizhevsky, I. Sutskever, and G. E. Hinton · 2012
Earlier work this paper cites.
Microsoft coco: Common objects in context
T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L. Zitnick · 2014
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition
Original
K. Simonyan and A. Zisserman · 2014
Earlier work this paper cites.
Deep residual learning for image recognition
Original
K. He, X. Zhang, S. Ren, and J. Sun · 2015
Earlier work this paper cites.
Faster r-cnn: Towards real-time object detection with region proposal networks
S. Ren, K. He, R. Girshick, and J. Sun · 2015
Earlier work this paper cites.
Going deeper with convolutions
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich · 2015
Earlier work this paper cites.
A convolutional encoder model for neural machine translation
Original
J. Gehring, M. Auli, D. Grangier, and Y. N. Dauphin · 2016
Earlier work this paper cites.
Wide residual networks
Original
S. Zagoruyko and N. Komodakis · 2016
Earlier work this paper cites.
Quo vadis, action recognition? a new model and the kinetics dataset
J. Carreira and A. Zisserman · 2017
Earlier work this paper cites.
Xception: Deep learning with depthwise separable convolutions
F. Chollet · 2017
Earlier work this paper cites.
Deformable convolutional networks
J. Dai, H. Qi, Y. Xiong, Y. Li, G. Zhang, H. Hu, and Y. Wei · 2017
Earlier work this paper cites.
Convolutional sequence to sequence learning
J. Gehring, M. Auli, D. Grangier, D. Yarats, and Y. N. Dauphin · 2017
Earlier work this paper cites.
Mask r-cnn
K. He, G. Gkioxari, P. Dollár, and R. Girshick · 2017
Earlier work this paper cites.
Mobilenets: Efficient convolutional neural networks for mobile vision applications
Original
A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam · 2017
Earlier work this paper cites.

Similar

Densely connected convolutional networks
G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger · 2017
Cited alongside, same era.
The kinetics human action video dataset
Original
W. Kay, J. Carreira, K. Simonyan, B. Zhang, C. Hillier, S. Vijayanarasimhan, F. Viola, T. Green, T. Back, P. Natsev, et al · 2017
Cited alongside, same era.
Feature pyramid networks for object detection
T.-Y. Lin, P. Dollar, R. Girshick, K. He, B. Hariharan, and S. Belongie · 2017
Cited alongside, same era.
Automatic differentiation in pytorch
A. Paszke, S. Gross, S. Chintala, G. Chanan, E. Yang, Z. DeVito, Z. Lin, A. Desmaison, L. Antiga, and A. Lerer · 2017
Cited alongside, same era.
Learning spatio-temporal representation with pseudo-3d residual networks
Z. Qiu, T. Yao, and T. Mei · 2017
Cited alongside, same era.
Attention is all you need
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin · 2017
Cited alongside, same era.
Graph attention networks
Original
P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Lio, and Y. Bengio · 2017
Cited alongside, same era.
Residual attention network for image classification
F. Wang, M. Jiang, C. Qian, S. Yang, C. Li, H. Zhang, X. Wang, and X. Tang · 2017
Cited alongside, same era.
Aggregated residual transformations for deep neural networks
S. Xie, R. Girshick, P. Dollár, Z. Tu, and K. He · 2017
Cited alongside, same era.
Cascade r-cnn: Delving into high quality object detection
Z. Cai and N. Vasconcelos · 2018
Cited alongside, same era.
Slowfast networks for video recognition
Original
C. Feichtenhofer, H. Fan, J. Malik, and K. He · 2018
Cited alongside, same era.
Relation networks for object detection
H. Hu, J. Gu, Z. Zhang, J. Dai, and Y. Wei · 2018
Cited alongside, same era.

Then

Ccnet: Criss-cross attention for semantic segmentation
Original
Z. Huang, X. Wang, L. Huang, C. Huang, Y. Wei, and W. Liu · 2018
Later among the works it cites.
Detnet: A backbone network for object detection
Original
Z. Li, C. Peng, G. Yu, X. Zhang, Y. Deng, and J. Sun · 2018
Later among the works it cites.
Non-local neural networks
X. Wang, R. Girshick, A. Gupta, and K. He · 2018
Later among the works it cites.
Cbam: Convolutional block attention module
S. Woo, J. Park, J.-Y. Lee, and I. So Kweon · 2018
Later among the works it cites.
Bag of tricks for image classification with convolutional neural networks
Original
J. Xie, T. He, Z. Zhang, H. Zhang, Z. Zhang, and M. Li · 2018
Later among the works it cites.
Rethinking spatiotemporal feature learning: Speed-accuracy trade-offs in video classification
S. Xie, C. Sun, J. Huang, Z. Tu, and K. Murphy · 2018
Later among the works it cites.
Ocnet: Object context network for scene parsing
Original
Y. Yuan and J. Wang · 2018
Later among the works it cites.
Context encoding for semantic segmentation
H. Zhang, K. Dana, J. Shi, Z. Zhang, X. Wang, A. Tyagi, and A. Agrawal · 2018
Later among the works it cites.
Self-attention generative adversarial networks
Original
H. Zhang, I. Goodfellow, D. Metaxas, and A. Odena · 2018
Later among the works it cites.
Shufflenet: An extremely efficient convolutional neural network for mobile devices
X. Zhang, X. Zhou, M. Lin, and J. Sun · 2018
Later among the works it cites.
Psanet: Point-wise spatial attention network for scene parsing
H. Zhao, Y. Zhang, S. Liu, J. Shi, C. Change Loy, D. Lin, and J. Jia · 2018
Later among the works it cites.
Deformable convnets v2: More deformable, better results
Original
X. Zhu, H. Hu, S. Lin, and J. Dai · 2018
Later among the works it cites.
Learning transferable architectures for scalable image recognition
Original
B. Zoph, V. Vasudevan, J. Shlens, and Q. V. Le · 2018
Later among the works it cites.
maskrcnn-benchmark: Fast, modular reference implementation of Instance Segmentation and Object Detection algorithms in PyTorch
F. Massa and R. Girshick · 2019
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…