2019

Action Recognition via Pose-Based Graph Convolutional Networks with Intermediate Dense Supervision

Shi, Lei, Zhang, Yifan, Cheng, Jian et al.

Understand

Pose-based action recognition has drawn considerable attention recently.

Existing methods exploit the joint positions to extract the body-part features from the activation map of the convolutional networks to assist human action recognition.
However, these features are simply concatenated or max-pooled in previous works.
The structured correlations among the body parts, which are essential for understanding complex human actions, are not fully exploited.

Built on

Action recognition by dense trajectories
Heng Wang, Alexander Klaser, Cordelia Schmid, and Cheng-Lin Liu · 2011
Earlier work this paper cites.
Articulated pose estimation with flexible mixtures-of-parts
Yi Yang and Deva Ramanan · 2011
Earlier work this paper cites.
UCF101: A dataset of 101 human actions classes from videos in the wild
Original
Khurram Soomro, Amir Roshan Zamir, and Mubarak Shah · 2012
Earlier work this paper cites.
Towards Understanding Action Recognition
Hueihan Jhuang, Juergen Gall, Silvia Zuffi, Cordelia Schmid, and Michael J. Black · 2013
Earlier work this paper cites.
The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains
David I Shuman, Sunil K Narang, Pascal Frossard, Antonio Ortega, and Pierre Vandergheynst · 2013
Earlier work this paper cites.
Action Recognition with Improved Trajectories
Heng Wang and Cordelia Schmid · 2013
Earlier work this paper cites.
From Actemes to Action: A Strongly-Supervised Representation for Detailed Action Understanding
W. Zhang, M. Zhu, and K. G. Derpanis · 2013
Earlier work this paper cites.
Two-stream convolutional networks for action recognition in videos
Karen Simonyan and Andrew Zisserman · 2014
Earlier work this paper cites.
P-cnn: Pose-based cnn features for action recognition
Guilhem Chéron, Ivan Laptev, and Cordelia Schmid · 2015
Earlier work this paper cites.
Hierarchical recurrent neural network for skeleton based action recognition
Yong Du, Wei Wang, and Liang Wang · 2015
Earlier work this paper cites.
Long-term correlation tracking
C. Ma, X. Yang, Zhang Chongyang, and M. H. Yang · 2015
Earlier work this paper cites.
Learning Spatiotemporal Features With 3d Convolutional Networks
Du Tran, Lubomir Bourdev, Rob Fergus, Lorenzo Torresani, and Manohar Paluri · 2015
Earlier work this paper cites.
Beyond short snippets: Deep networks for video classification
Joe Yue-Hei Ng, Matthew Hausknecht, Sudheendra Vijayanarasimhan, Oriol Vinyals, Rajat Monga, and George Toderici · 2015
Earlier work this paper cites.

Similar

Action Recognition with Joints-Pooled 3d Deep Convolutional Descriptors
Congqi Cao, Yifan Zhang, Chunjie Zhang, and Hanqing Lu · 2016
Cited alongside, same era.
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
Michaël Defferrard, Xavier Bresson, and Pierre Vandergheynst · 2016
Cited alongside, same era.
NTU RGB+D: A Large Scale Dataset for 3d Human Activity Analysis
Amir Shahroudy, Jun Liu, Tian-Tsong Ng, and Gang Wang · 2016
Cited alongside, same era.
Realtime multi-person 2d pose estimation using part affinity fields
Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh · 2017
Cited alongside, same era.
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Joao Carreira and Andrew Zisserman · 2017
Cited alongside, same era.
Rpan: An end-to-end recurrent pose-attention network for action recognition in videos
Wenbin Du, Yali Wang, and Yu Qiao · 2017
Cited alongside, same era.
Pose for Action - Action for Pose
U. Iqbal, M. Garbade, and J. Gall · 2017
Cited alongside, same era.
The Kinetics Human Action Video Dataset
Original
Will Kay, Joao Carreira, Karen Simonyan, Brian Zhang, Chloe Hillier, Sudheendra Vijayanarasimhan, Fabio Viola, Tim Green, Trevor Back, Paul Natsev, and others · 2017
Cited alongside, same era.
Glimpse Clouds: Human Activity Recognition From Unstructured Feature Points
Fabien Baradel, Christian Wolf, Julien Mille, and Graham W. Taylor · 2018
Cited alongside, same era.
Skeleton-Based Action Recognition with Gated Convolutional Neural Networks
C. Cao, C. Lan, Y. Zhang, W. Zeng, H. Lu, and Y. Zhang · 2018
Cited alongside, same era.
Potion: Pose motion representation for action recognition
Vasileios Choutas, Philippe Weinzaepfel, Jérôme Revaud, and Cordelia Schmid · 2018
Cited alongside, same era.
Can Spatiotemporal 3d CNNs Retrace the History of 2d CNNs and ImageNet?
Kensho Hara, Hirokatsu Kataoka, and Yutaka Satoh · 2018
Cited alongside, same era.

Then

Recognizing Human Actions as the Evolution of Pose Estimation Maps
Mengyuan Liu and Junsong Yuan · 2018
Later among the works it cites.
2d/3d Pose Estimation and Action Recognition Using Multitask Deep Learning
Diogo C. Luvizon, David Picard, and Hedi Tabia · 2018
Later among the works it cites.
Non-Local Neural Networks
Xiaolong Wang, Ross Girshick, Abhinav Gupta, and Kaiming He · 2018
Later among the works it cites.
Videos as Space-Time Region Graphs
Xiaolong Wang and Abhinav Gupta · 2018
Later among the works it cites.
Temporal hallucinating for action recognition with few still images
Yali Wang, Lei Zhou, and Yu Qiao · 2018
Later among the works it cites.
Rethinking spatiotemporal feature learning: Speed-accuracy trade-offs in video classification
Saining Xie, Chen Sun, Jonathan Huang, Zhuowen Tu, and Kevin Murphy · 2018
Later among the works it cites.
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Sijie Yan, Yuanjun Xiong, and Dahua Lin · 2018
Later among the works it cites.
Part-Aligned Pose-Guided Recurrent Network for Action Recognition
Linjiang Huang, Yan Huang, Wangli Ouyang, and Liang Wang · 2019
Closest in time.
Joint Dynamic Pose Image and Space Time Reversal for Human Action Recognition from Videos
Mengyuan Liu, Fanyang Meng, Chen Chen, and Songtao Wu · 2019
Closest in time.
Skeleton-Based Action Recognition With Directed Graph Neural Networks
Lei Shi, Yifan Zhang, Jian Cheng, and Hanqing Lu · 2019
Closest in time.
Two-Stream Adaptive Graph Convolutional Networks for Skeleton-Based Action Recognition
Lei Shi, Yifan Zhang, Jian Cheng, and Hanqing Lu · 2019
Closest in time.
Gesture Recognition using Spatiotemporal Deformable Convolutional Represention
Lei Shi, Yifan Zhang, Cheng Jian, and Lu Hanqing · 2019
Closest in time.
PA3d: Pose-Action 3d Machine for Video Recognition
An Yan, Yali Wang, Zhifeng Li, and Yu Qiao · 2019
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…