Fetching the paper…
Reading the bibliography…
We present EgoAllo, a system for human motion estimation from a head-mounted device.
Convolutional networks for images, speech, and time series
Yann LeCun, Yoshua Bengio, et al · 1995
Earlier work this paper cites.
Bayesian reconstruction of 3d human motion from single-camera video
Nicholas Howe, Michael Leventon, and William Freeman · 1999
Earlier work this paper cites.
Slow feature analysis: Unsupervised learning of invariances
Laurenz Wiskott and Terrence J Sejnowski · 2002
Earlier work this paper cites.
Distinctive image features from scale-invariant keypoints
David G Lowe · 2004
Earlier work this paper cites.
Scape: shape completion and animation of people
Dragomir Anguelov, Praveen Srinivasan, Daphne Koller, Sebastian Thrun, Jim Rodgers, and James Davis · 2005
Earlier work this paper cites.
3d generic object categorization, localization and pose estimation
Silvio Savarese and Li Fei-Fei · 2007
Earlier work this paper cites.
Estimating human shape and pose from a single image
Peng Guan, Alexander Weiss, Alexandru O Balan, and Michael J Black · 2009
Earlier work this paper cites.
Physics-based person tracking using the anthropomorphic walker
Marcus A Brubaker, David J Fleet, and Aaron Hertzmann · 2010
Earlier work this paper cites.
Denoising diffusion implicit models
Jiaming Song, Chenlin Meng, and Stefano Ermon · 2010
Earlier work this paper cites.
Motion capture from body-mounted cameras
Takaaki Shiratori, Hyun Soo Park, Leonid Sigal, Yaser Sheikh, and Jessica K Hodgins · 2011
Earlier work this paper cites.
Score-based generative modeling through stochastic differential equations
Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole · 2011
Earlier work this paper cites.
Tilt: Transform invariant low-rank textures
Zhengdong Zhang, Arvind Ganesh, Xiao Liang, and Yi Ma · 2012
Earlier work this paper cites.
Auto-encoding variational bayes
Diederik P Kingma and Max Welling · 2013
Earlier work this paper cites.
Locally scale-invariant convolutional neural networks
Angjoo Kanazawa, Abhishek Sharma, and David Jacobs · 2014
Earlier work this paper cites.
Stochastic backpropagation and approximate inference in deep generative models
Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra · 2014
Earlier work this paper cites.
Deep unsupervised learning using nonequilibrium thermodynamics
Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli · 2015
Earlier work this paper cites.
Group equivariant convolutional networks
Taco Cohen and Max Welling · 2016
Earlier work this paper cites.
Egocap: egocentric marker-less motion capture with two fisheye cameras
Helge Rhodin, Christian Richardt, Dan Casas, Eldar Insafutdinov, Mohammad Shafiei, Hans-Peter Seidel, Bernt Schiele, and Christian Theobalt · 2016
Earlier work this paper cites.
Pointnet: Deep learning on point sets for 3d classification and segmentation
R Qi Charles, Hao Su, Mo Kaichun, and Leonidas J Guibas · 2017
Earlier work this paper cites.
Unite the people: Closing the loop between 3d and 2d human representations
Christoph Lassner, Javier Romero, Martin Kiefel, Federica Bogo, Michael J Black, and Peter V Gehler · 2017
Earlier work this paper cites.
A simple yet effective baseline for 3d human pose estimation
Julieta Martinez, Rayat Hossain, Javier Romero, and James J Little · 2017
Earlier work this paper cites.
Lcr-net: Localization-classification-regression for human pose
Gregory Rogez, Philippe Weinzaepfel, and Cordelia Schmid · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Deep sets
Manzil Zaheer, Satwik Kottur, Siamak Ravanbakhsh, Barnabas Poczos, Russ R Salakhutdinov, and Alexander J Smola · 2017
Earlier work this paper cites.
JAX: composable transformations of Python+NumPy programs, 2018
James Bradbury, Roy Frostig, Peter Hawkins, Matthew James Johnson, Chris Leary, Dougal Maclaurin, George Necula, Adam Paszke, Jake VanderPlas, Skye Wanderman-Milne, and Qiao Zhang · 2018
Earlier work this paper cites.
End-to-end recovery of human shape and pose
Angjoo Kanazawa, Michael J Black, David W Jacobs, and Jitendra Malik · 2018
Earlier work this paper cites.
Neural body fitting: Unifying deep learning and model based human pose and shape estimation
Mohamed Omran, Christoph Lassner, Gerard Pons-Moll, Peter Gehler, and Bernt Schiele · 2018
Earlier work this paper cites.
Learning to estimate 3d human pose and shape from a single color image
Georgios Pavlakos, Luyang Zhu, Xiaowei Zhou, and Kostas Daniilidis · 2018
Earlier work this paper cites.
Sfv: Reinforcement learning of physical skills from videos
Xue Bin Peng, Angjoo Kanazawa, Jitendra Malik, Pieter Abbeel, and Sergey Levine · 2018
Earlier work this paper cites.
Tensor field networks: Rotation-and translation-equivariant neural networks for 3d point clouds
Nathaniel Thomas, Tess Smidt, Steven Kearnes, Lusann Yang, Li Li, Kai Kohlhoff, and Patrick Riley · 2018
Earlier work this paper cites.
3d ego-pose estimation via imitation learning
Ye Yuan and Kris Kitani · 2018
Earlier work this paper cites.
Holopose: Holistic 3d human reconstruction in-the-wild
Riza Alp Guler and Iasonas Kokkinos · 2019
Earlier work this paper cites.
Learning 3d human dynamics from video
Angjoo Kanazawa, Jason Y Zhang, Panna Felsen, and Jitendra Malik · 2019
Earlier work this paper cites.
Learning to reconstruct 3d human pose and shape via model-fitting in the loop
Nikos Kolotouros, Georgios Pavlakos, Michael J Black, and Kostas Daniilidis · 2019
Earlier work this paper cites.
Estimating 3d motion and forces of person-object interactions from monocular video
Zongmian Li, Jiri Sedlar, Justin Carpentier, Ivan Laptev, Nicolas Mansard, and Josef Sivic · 2019
Earlier work this paper cites.
Amass: Archive of motion capture as surface shapes
Naureen Mahmood, Nima Ghorbani, Nikolaus F Troje, Gerard Pons-Moll, and Michael J Black · 2019
Earlier work this paper cites.
Expressive body capture: 3D hands, face, and body from a single image
Georgios Pavlakos, Vasileios Choutas, Nima Ghorbani, Timo Bolkart, Ahmed A. A. Osman, Dimitrios Tzionas, and Michael J. Black · 2019
Cited alongside, same era.
xr-egopose: Egocentric 3d human pose from an hmd camera
Denis Tome, Patrick Peluse, Lourdes Agapito, and Hernan Badino · 2019
Cited alongside, same era.
Mo 2 cap 2: Real-time mobile 3d motion capture with a cap-mounted fisheye camera
Weipeng Xu, Avishek Chatterjee, Michael Zollhoefer, Helge Rhodin, Pascal Fua, Hans-Peter Seidel, and Christian Theobalt · 2019
Cited alongside, same era.
Ego-pose estimation and forecasting as real-time pd control
Ye Yuan and Kris Kitani · 2019
Cited alongside, same era.
A simple framework for contrastive learning of visual representations
Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton · 2020
Cited alongside, same era.
Probabilistic character motion synthesis using a hierarchical deep latent variable model
Listen, denoise, action! audio-driven motion synthesis with diffusion models
Simon Alexanderson, Rajmund Nagy, Jonas Beskow, and Gustav Eje Henter · 2023
Later among the works it cites.
Multidiffusion: Fusing diffusion paths for controlled image generation
Omer Bar-Tal, Lior Yariv, Yaron Lipman, and Tali Dekel · 2023
Later among the works it cites.
Bodiffusion: Diffusing sparse observations for full-body human motion synthesis
Angela Castillo, Maria Escobar, Guillaume Jeanneret, Albert Pumarola, Pablo Arbeláez, Ali Thabet, and Artsiom Sanakoyeu · 2023
Later among the works it cites.
Gfpose: Learning 3d human pose prior with gradient fields
Hai Ci, Mingdong Wu, Wentao Zhu, Xiaoxuan Ma, Hao Dong, Fangwei Zhong, and Yizhou Wang · 2023
Later among the works it cites.
Generalizing neural human fitting to unseen poses with articulated se (3) equivariance
Haiwen Feng, Peter Kulits, Shichen Liu, Michael J Black, and Victoria Fernandez Abrevaya · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Saeed Ghorbani, Calden Wloka, Ali Etemad, Marcus A Brubaker, and Nikolaus F Troje · 2020
Cited alongside, same era.
Denoising diffusion probabilistic models
Jonathan Ho, Ajay Jain, and Pieter Abbeel · 2020
Cited alongside, same era.
Vibe: Video inference for human body pose and shape estimation
Muhammed Kocabas, Nikos Athanasiou, and Michael J Black · 2020
Cited alongside, same era.
Character controllers using motion vaes
Hung Yu Ling, Fabio Zinno, George Cheng, and Michiel Van De Panne · 2020
Cited alongside, same era.
You2me: Inferring body pose in egocentric video via first and second person interactions
Evonne Ng, Donglai Xiang, Hanbyul Joo, and Kristen Grauman · 2020
Cited alongside, same era.
Contact and human dynamics from monocular video
Davis Rempe, Leonidas J Guibas, Aaron Hertzmann, Bryan Russell, Ruben Villegas, and Jimei Yang · 2020
Cited alongside, same era.
Selfpose: 3d egocentric pose estimation from a headset mounted camera
Denis Tome, Thiemo Alldieck, Patrick Peluse, Gerard Pons-Moll, Lourdes Agapito, Hernan Badino, and Fernando De la Torre · 2020
Cited alongside, same era.
Humans in 4D: Reconstructing and tracking humans with transformers
Shubham Goel, Georgios Pavlakos, Jathushan Rajasegaran, Angjoo Kanazawa*, and Jitendra Malik* · 2023
Later among the works it cites.
Ego-exo4d: Understanding skilled human activity from first-and third-person perspectives
Kristen Grauman, Andrew Westbury, Lorenzo Torresani, Kris Kitani, Jitendra Malik, Triantafyllos Afouras, Kumar Ashutosh, Vijay Baiyya, Siddhant Bansal, Bikram Boote, et al · 2023
Later among the works it cites.
Egoposer: Robust real-time ego-body pose estimation in large scenes
Jiaxi Jiang, Paul Streli, Manuel Meier, Andreas Fender, and Christian Holz · 2023
Later among the works it cites.
Guided motion diffusion for controllable human motion synthesis
Korrawe Karunratanakul, Konpat Preechakul, Supasorn Suwajanakorn, and Siyu Tang · 2023
Later among the works it cites.
Flame: Free-form language-based motion synthesis & editing
Jihoon Kim, Jiseob Kim, and Sungjoon Choi · 2023
Later among the works it cites.
Nifty: Neural object interaction fields for guided human motion synthesis
Nilesh Kulkarni, Davis Rempe, Kyle Genova, Abhijit Kundu, Justin Johnson, David Fouhey, and Leonidas Guibas · 2023
Later among the works it cites.
Smpl: A skinned multi-person linear model
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black · 2023
Later among the works it cites.
Egoloc: Revisiting 3d object localization from egocentric videos with visual queries
Jinjie Mai, Abdullah Hamdi, Silvio Giancola, Chen Zhao, and Bernard Ghanem · 2023
Later among the works it cites.
Aria digital twin: A new benchmark dataset for egocentric 3d machine perception
Xiaqing Pan, Nicholas Charron, Yongqian Yang, Scott Peters, Thomas Whelan, Chen Kong, Omkar Parkhi, Richard Newcombe, and Yuheng Carl Ren · 2023
Later among the works it cites.
Reconstructing hands in 3D with transformers
Georgios Pavlakos, Dandan Shan, Ilija Radosavovic, Angjoo Kanazawa, David Fouhey, and Jitendra Malik · 2023
Later among the works it cites.
State of the art on diffusion models for visual computing
Ryan Po, Wang Yifan, Vladislav Golyanik, Kfir Aberman, Jonathan T Barron, Amit H Bermano, Eric Ryan Chan, Tali Dekel, Aleksander Holynski, Angjoo Kanazawa, et al · 2023
Later among the works it cites.
Human motion diffusion as a generative prior
Yonatan Shafir, Guy Tevet, Roy Kapon, and Amit H Bermano · 2023
Later among the works it cites.
Project aria: A new tool for egocentric multi-modal ai research
Kiran Somasundaram, Jing Dong, Huixuan Tang, Julian Straub, Mingfei Yan, Michael Goesele, Jakob Julian Engel, Renzo De Nardi, and Richard Newcombe · 2023
Later among the works it cites.
Edge: Editable dance generation from music
Jonathan Tseng, Rodrigo Castellon, and Karen Liu · 2023
Later among the works it cites.
Equivact: Sim(3)-equivariant visuomotor policies beyond rigid object manipulation, 2023
Jingyun Yang, Congyue Deng, Jimmy Wu, Rika Antonova, Leonidas Guibas, and Jeannette Bohg · 2023
Later among the works it cites.
Decoupling human and camera motion from videos in the wild
Vickie Ye, Georgios Pavlakos, Jitendra Malik, and Angjoo Kanazawa · 2023
Later among the works it cites.
Fangneng Zhan, Lingjie Liu, Adam Kortylewski, and Christian Theobalt · 2023
Later among the works it cites.
Diffcollage: Parallel generation of large content with diffusion models
Qinsheng Zhang, Jiaming Song, Xun Huang, Yongxin Chen, and Ming-Yu Liu · 2023
Later among the works it cites.
Seamless human motion composition with blended positional encodings
German Barquero, Sergio Escalera, and Cristina Palmero · 2024
Closest in time.
Egolifter: Open-world 3d segmentation for egocentric perception
Qiao Gu, Zhaoyang Lv, Duncan Frost, Simon Green, Julian Straub, and Chris Sweeney · 2024
Closest in time.
Egolm: Multi-modal language model of egocentric motions
Fangzhou Hong, Vladimir Guzov, Hyo Jin Kim, Yuting Ye, Richard Newcombe, Ziwei Liu, and Lingni Ma · 2024
Closest in time.
Back to optimization: Diffusion-based zero-shot 3d human pose estimation
Zhongyu Jiang, Zhuoran Zhou, Lei Li, Wenhao Chai, Cheng-Yen Yang, and Jenq-Neng Hwang · 2024
Closest in time.
Pace: Human and motion estimation from in-the-wild videos
Muhammed Kocabas, Ye Yuan, Pavlo Molchanov, Yunrong Guo, Michael J. Black, Otmar Hilliges, Jan Kautz, and Umar Iqbal · 2024
Closest in time.
Mocap everyone everywhere: Lightweight motion capture with smartwatches and a head-mounted camera
Jiye Lee and Hanbyul Joo · 2024
Closest in time.
Nymeria: A massive collection of multimodal egocentric daily motion in the wild
Lingni Ma, Yuting Ye, Fangzhou Hong, Vladimir Guzov, Yifeng Jiang, Rowan Postyeni, Luis Pesqueira, Alexander Gamino, Vijay Baiyya, Hyo Jin Kim, et al · 2024
Closest in time.
Spatial cognition from egocentric video: Out of sight, not out of mind
Chiara Plizzari, Shubham Goel, Toby Perrett, Jacob Chalk, Angjoo Kanazawa, and Dima Damen · 2024
Closest in time.
Roformer: Enhanced transformer with rotary position embedding
Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu · 2024
Closest in time.
Egocentric whole-body motion capture with fisheyevit and diffusion-based motion refinement
Jian Wang, Zhe Cao, Diogo Luvizon, Lingjie Liu, Kripasindhu Sarkar, Danhang Tang, Thabo Beeler, and Christian Theobalt · 2024
Closest in time.
Equibot: Sim (3)-equivariant diffusion policy for generalizable and data efficient learning
Jingyun Yang, Zi-ang Cao, Congyue Deng, Rika Antonova, Shuran Song, and Jeannette Bohg · 2024
Closest in time.
Egogaussian: Dynamic scene understanding from egocentric video with 3d gaussian splatting
Daiwei Zhang, Gengyan Li, Jiajie Li, Mickaël Bressieux, Otmar Hilliges, Marc Pollefeys, Luc Van Gool, and Xi Wang · 2024
Closest in time.