2015

Pose Embeddings: A Deep Architecture for Learning to Match Human Poses

Mori, Greg, Pantofaru, Caroline, Kothari, Nisarg et al.

Understand

We present a method for learning an embedding that places images of humans in similar poses nearby.

This embedding can be used as a direct method of comparing images based on human pose, avoiding potential challenges of estimating body joint positions.
Pose embedding learning is formulated under a triplet-based distance criterion.
A deep architecture is used to allow learning of a representation capable of making distinctions between different poses.

Built on

Pedestrian detection from a moving vehicle
D. M. Gavrila · 2000
Earlier work this paper cites.
Estimating human body configurations using shape context matching
G. Mori and J. Malik · 2002
Earlier work this paper cites.
Distance metric learning with application to clustering with side-information
E. P. Xing, A. Y. Ng, M. I. Jordan, and S. J. Russell · 2002
Earlier work this paper cites.
Automatic annotation of everyday movements
D. Ramanan and D. A. Forsyth · 2003
Earlier work this paper cites.
Learning a distance metric from relative comparisons
M. Schultz and T. Joachims · 2003
Earlier work this paper cites.
Fast pose estimation with parameter sensitive hashing
G. Shakhnarovich, P. Viola, and T. Darrell · 2003
Earlier work this paper cites.
3d human pose from silhouettes by relevance vector regression
A. Agarwal and B. Triggs · 2004
Earlier work this paper cites.
Boostmap: A method for efficient approximate similarity rankings
V. Athitsos, J. Alon, S. Sclaroff, and G. Kollios · 2004
Earlier work this paper cites.
Neighbourhood components analysis
J. Goldberger, S. Roweis, G. Hinton, and R. Salakhutdinov · 2004
Earlier work this paper cites.
Model-based motion clustering using boosted mixture modeling
V. Pavlovic · 2004
Earlier work this paper cites.
Pictorial structures for object recognition
P. F. Felzenszwalb and D. P. Huttenlocher · 2005
Earlier work this paper cites.
Image retrieval and classification using local distance functions
A. Frome, Y. Singer, and J. Malik · 2006
Earlier work this paper cites.
3d people tracking with gaussian process dynamical models
R. Urtasun, D. J. Fleet, and P. Fua · 2006
Earlier work this paper cites.
Learning globally-consistent local distance functions for shape-based image retrieval and classification
A. Frome, Y. Singer, F. Sha, and J. Malik · 2007
Earlier work this paper cites.

Similar

Fast image search for learned metrics
P. Jain, B. Kulis, and K. Grauman · 2008
Cited alongside, same era.
Poselets: Body part detectors trained using 3d human pose annotations
L. Bourdev and J. Malik · 2009
Cited alongside, same era.
Pose search: retrieving people using their pose
V. Ferrari, M. Marin-Jimenez, and A. Zisserman · 2009
Cited alongside, same era.
Learning actions from the web
N. Ikizler-Cinbis, R. G. Cinbis, and S. Sclaroff · 2009
Cited alongside, same era.
Recognizing actions by shape-motion prototype trees
Z. Lin, Z. Jiang, and L. S. Davis · 2009
Cited alongside, same era.
Distance metric learning for large margin nearest neighbor classification
K. Q. Weinberger and L. K. Saul · 2009
Cited alongside, same era.
Multiple instance metric learning from automatically labeled bags of faces
M. Guillaumin, J. J. Verbeek, and C. Schmid · 2010
Cited alongside, same era.
Pose-sensitive embedding by nonlinear nca regression
G. W. Taylor, R. Fergus, G. Williams, I. Spiro, and C. Bregler · 2010
Cited alongside, same era.
Recognizing human actions from still images with latent poses
W. Yang, Y. Wang, and G. Mori · 2010
Cited alongside, same era.
Modeling mutual context of object and human pose in human-object interaction activities
B. Yao and L. Fei-Fei · 2010
Cited alongside, same era.
Learning a mixture of sparse distance metrics for classification and dimensionality reduction
Y. Hong, Q. Li, J. Jiang, and Z. Tu · 2011
Cited alongside, same era.
Latent structured models for human pose estimation
C. Ionescu, F. Li, , and C. Sminchisescu · 2011
Cited alongside, same era.

Then

Articulated pose estimation using flexible mixtures of parts
Y. Yang and D. Ramanan · 2011
Later among the works it cites.
Hamming distance metric learning
M. Norouzi, D. J. Fleet, and R. Salakhutdinov · 2012
Later among the works it cites.
Distance-based image classification: Generalizing to new classes at near-zero cost
T. Mensink, J. J. Verbeek, F. Perronnin, and G. Csurka · 2013
Later among the works it cites.
Poselet conditioned pictorial structures
L. Pishchulin, M. Andriluka, P. Gehler, , and B. Schiele · 2013
Later among the works it cites.
Modec: Multimodal decomposable models for human pose estimation
B. Sapp and B. Taskar · 2013
Later among the works it cites.
2d human pose estimation: New benchmark and state of the art analysis
M. Andriluka, L. Pishchulin, P. Gehler, and B. Schiele · 2014
Later among the works it cites.
Discovering groups of people in images
W. Choi, Y. Chao, C. Pantofaru, and S. Savarese · 2014
Later among the works it cites.
Large-scale video classification with convolutional neural networks
A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei · 2014
Later among the works it cites.
Going deeper with convolutions
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich · 2014
Later among the works it cites.
Joint training of a convolutional network and a graphical model for human pose estimation
J. Tompson, A. Jain, Y. LeCun, and C. Bregler · 2014
Later among the works it cites.
Deeppose: Human pose estimation via deep neural networks
A. Toshev and C. Szegedy · 2014
Later among the works it cites.
Learning fine-grained image similarity with deep ranking
J. Wang, Y. Song, T. Leung, C. Rosenberg, J. Wang, J. Philbin, B. Chen, and Y. Wu · 2014
Later among the works it cites.
ImageNet Large Scale Visual Recognition Challenge
O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei · 2015
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…