Fetching the paper…
Reading the bibliography…
We present SimXR, a method for controlling a simulated avatar from information (headset pose and cameras) obtained from AR / VR headsets.
A reduction of imitation learning and structured prediction to no-regret online learning
Stephane Ross, Geoffrey J Gordon, and J Andrew Bagnell · 2010
Earlier work this paper cites.
Learning phrase representations using rnn encoder–decoder for statistical machine translation
Kyunghyun Cho, Bart van Merrienboer, Çaglar Gülçehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio · 2014
Earlier work this paper cites.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2015
Earlier work this paper cites.
Batch normalization: Accelerating deep network training by reducing internal covariate shift
Sergey Ioffe and Christian Szegedy · 2015
Earlier work this paper cites.
Smpl: A skinned multi-person linear model
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black · 2015
Earlier work this paper cites.
Andrei A Rusu, Sergio Gomez Colmenarejo, Caglar Gulcehre, Guillaume Desjardins, James Kirkpatrick, Razvan Pascanu, Volodymyr Mnih, Koray Kavukcuoglu, and Raia Hadsell · 2015
Earlier work this paper cites.
Convolutional, long short-term memory, fully connected deep neural networks
Tara N. Sainath, Oriol Vinyals, Andrew W. Senior, and Hasim Sak · 2015
Earlier work this paper cites.
Keep it smpl: Automatic estimation of 3d human pose and shape from a single image
Federica Bogo, Angjoo Kanazawa, Christoph Lassner, Peter Gehler, Javier Romero, and Michael J Black · 2016
Earlier work this paper cites.
Egocap: egocentric marker-less motion capture with two fisheye cameras
Helge Rhodin, Christian Richardt, Dan Casas, Eldar Insafutdinov, Mohammad Shafiei, Hans-Peter Seidel, Bernt Schiele, and Christian Theobalt · 2016
Earlier work this paper cites.
Sigmoid-weighted linear units for neural network function approximation in reinforcement learning
Stefan Elfwing, Eiji Uchibe, and Kenji Doya · 2017
Earlier work this paper cites.
Seeing invisible poses: Estimating 3d body pose from egocentric video
Hao Jiang and Kristen Grauman · 2017
Earlier work this paper cites.
Proximal policy optimization algorithms, 2017
John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov · 2017
Earlier work this paper cites.
Physics-based motion capture imitation with deep reinforcement learning
Nuttapong Chentanez, Matthias Müller, Miles Macklin, Viktor Makoviychuk, and Stefan Jeschke · 2018
Earlier work this paper cites.
Deepmimic
Xue Bin Peng, Pieter Abbeel, Sergey Levine, and Michiel van de Panne · 2018
Earlier work this paper cites.
Kickstarting deep reinforcement learning
Simon Schmitt, Jonathan J Hudson, Augustin Zidek, Simon Osindero, Carl Doersch, Wojciech M Czarnecki, Joel Z Leibo, Heinrich Kuttler, Andrew Zisserman, Karen Simonyan, and S M Ali Eslami · 2018
Earlier work this paper cites.
Group Normalization , pages 3–19
Yuxin Wu and Kaiming He · 2018
Earlier work this paper cites.
Mo2cap2: Real-time mobile 3d motion capture with a cap-mounted fisheye camera
Weipeng Xu, Avishek Chatterjee, Michael Zollhoefer, Helge Rhodin, Pascal Fua, Hans-Peter Seidel, and Christian Theobalt · 2018
Earlier work this paper cites.
3d ego-pose estimation via imitation learning
Ye Yuan and Kris Kitani · 2018
Earlier work this paper cites.
Amass: Archive of motion capture as surface shapes
Naureen Mahmood, Nima Ghorbani, Nikolaus F Troje, Gerard Pons-Moll, and Michael J Black · 2019
Earlier work this paper cites.
Expressive body capture: 3d hands, face, and body from a single image
Georgios Pavlakos, Vasileios Choutas, Nima Ghorbani, Timo Bolkart, Ahmed A A Osman, Dimitrios Tzionas, and Michael J Black · 2019
Earlier work this paper cites.
Mcp: Learning composable hierarchical control with multiplicative compositional policies
Xue Bin Peng, Michael Chang, Grace Zhang, Pieter Abbeel, and Sergey Levine · 2019
Earlier work this paper cites.
Ego-pose estimation and forecasting as real-time pd control
Ye Yuan and Kris Kitani · 2019
Earlier work this paper cites.
On the continuity of rotation representations in neural networks
Yi Zhou, Connelly Barnes, Jingwan Lu, Jimei Yang, and Hao Li · 2019
Earlier work this paper cites.
Vibe: Video inference for human body pose and shape estimation
Muhammed Kocabas, Nikos Athanasiou, and Michael J Black · 2020
Cited alongside, same era.
Catch and carry: Reusable neural controllers for vision-guided whole-body tasks
Josh Merel, Saran Tunyasuvunakool, Arun Ahuja, Yuval Tassa, Leonard Hasenclever, Vu Pham, Tom Erez, Greg Wayne, and Nicolas Heess · 2020
Cited alongside, same era.
Contact and human dynamics from monocular video
Davis Rempe, Leonidas J Guibas, Aaron Hertzmann, Bryan Russell, Ruben Villegas, and Jimei Yang · 2020
Cited alongside, same era.
Physcap: Physically plausible monocular 3d motion capture in real time
Soshi Shimada, Vladislav Golyanik, Weipeng Xu, and Christian Theobalt · 2020
Cited alongside, same era.
Selfpose: 3d egocentric pose estimation from a headset mounted camera
Denis Tome, Thiemo Alldieck, Patrick Peluse, Gerard Pons-Moll, Lourdes Agapito, Hernan Badino, and Fernando De la Torre · 2020
Neural mocon: Neural motion control for physically plausible human motion capture
Buzhen Huang, Liang Pan, Yuan Yang, Jingyi Ju, and Yangang Wang · 2022
Later among the works it cites.
Avatarposer: Articulated full-body pose tracking from sparse motion sensing
Jiaxi Jiang, Paul Streli, Huajian Qiu, Andreas Fender, Larissa Laich, Patrick Snape, and Christian Holz · 2022
Later among the works it cites.
Ego-body pose estimation via ego-head pose estimation
Jiaman Li, C Karen Liu, and Jiajun Wu · 2022
Later among the works it cites.
Embodied scene-aware human pose estimation
Zhengyi Luo, Shun Iwase, Ye Yuan, and Kris Kitani · 2022
Later among the works it cites.
Combining motion matching and orientation prediction to animate avatars for consumer-grade vr devices
Jose Luis Ponton, Haoran Yun, Carlos Andujar, and Nuria Pelechano · 2022
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Unicon: Universal neural controller for physics-based character motion
Tingwu Wang, Yunrong Guo, Maria Shugrina, and Sanja Fidler · 2020
Cited alongside, same era.
A scalable approach to control diverse behaviors for physically simulated characters
Jungdam Won, Deepak Gopinath, and Jessica Hodgins · 2020
Cited alongside, same era.
Residual force control for agile human behavior imitation and extended motion synthesis
Ye Yuan and Kris Kitani · 2020
Cited alongside, same era.
Supertrack: motion tracking for physically simulated characters using supervised learning
Levi Fussell, Kevin Bergamin, and Daniel Holden · 2021
Cited alongside, same era.
Bottom-up human pose estimation via disentangled keypoint regression
Zigang Geng, Ke Sun, Bin Xiao, Zhaoxiang Zhang, and Jingdong Wang · 2021
Cited alongside, same era.
Dynamics-regulated kinematic policy for egocentric pose estimation
Zhengyi Luo, Ryo Hachiuma, Ye Yuan, and Kris Kitani · 2021
Cited alongside, same era.
Isaac gym: High performance gpu-based physics simulation for robot learning
Viktor Makoviychuk, Lukasz Wawrzyniak, Yunrong Guo, Michelle Lu, Kier Storey, Miles Macklin, David Hoeller, Nikita Rudin, Arthur Allshire, Ankur Handa, and Gavriel State · 2021
Cited alongside, same era.
Later among the works it cites.
István Sárándi, Alexander Hermans, and Bastian Leibe · 2022
Later among the works it cites.
Scene-aware egocentric 3d human pose estimation
Jian Wang, Lingjie Liu, Weipeng Xu, Kripasindhu Sarkar, Diogo Luvizon, and Christian Theobalt · 2022
Later among the works it cites.
Questsim: Human motion tracking from sparse sensors with simulated avatars
Alexander Winkler, Jungdam Won, and Yuting Ye · 2022
Later among the works it cites.
Physics-based character controllers using conditional vaes
Jungdam Won, Deepak Gopinath, and Jessica Hodgins · 2022
Later among the works it cites.
https://www.projectaria.com/ , a
Introducing project aria, from meta · 2023
Later among the works it cites.
https://www.meta.com/ie/quest/products/quest-2/ , b
Meta quest 2: Immersive all-in-one VR headset · 2023
Later among the works it cites.
https://www.apple.com/apple-vision-pro/ , c
Apple vision pro · 2023
Later among the works it cites.
https://www.meta.com/ie/quest/quest-3/ , d
Meta quest 3: New mixed reality VR headset – shop now · 2023
Later among the works it cites.
Hmd-nemo: Online 3d avatar motion generation from sparse observations
Sadegh Aliakbarian, Fatemeh Saleh, David Collier, Pashmina Cameron, and Darren Cosker · 2023
Later among the works it cites.
Unity real-time development platform
Beta Program · 2023
Later among the works it cites.
Questenvsim: Environment-aware simulated motion tracking from sparse sensors
Sunmin Lee, Sebastian Starke, Yuting Ye, Jungdam Won, and Alexander Winkler · 2023
Later among the works it cites.
Aria digital twin: A new benchmark dataset for egocentric 3d machine perception
Xiaqing Pan, Nicholas Charron, Yongqian Yang, Scott Peters, Thomas Whelan, Chen Kong, Omkar Parkhi, Richard Newcombe, and Carl Yuheng Ren · 2023
Later among the works it cites.
Diffmimic: Efficient motion mimicking with differentiable physics
Jiawei Ren, Cunjun Yu, Siwei Chen, Xiao Ma, Liang Pan, and Ziwei Liu · 2023
Later among the works it cites.
Project aria: A new tool for egocentric multi-modal ai research
Kiran K. Somasundaram, Jing Dong, Huixuan Tang, Julian Straub, Mingfei Yan, Michael Goesele, Jakob J. Engel, Renzo De Nardi, and Richard A. Newcombe · 2023
Later among the works it cites.
Learning human dynamics in autonomous driving scenarios
Jingbo Wang, Ye Yuan, Zhengyi Luo, Kevin Xie, Dahua Lin, Umar Iqbal, Sanja Fidler, Sameh Khamis, Hong Kong, and Mellon University, Carnegie · 2023
Later among the works it cites.
Ziwen Zhuang, Zipeng Fu, Jianren Wang, Christopher Atkeson, Soeren Schwertfeger, Chelsea Finn, and Hang Zhao · 2023
Later among the works it cites.
Learning human-to-humanoid real-time whole-body teleoperation, 2024
Tairan He, Zhengyi Luo, Wenli Xiao, Chong Zhang, Kris Kitani, Changliu Liu, and Guanya Shi · 2024
Closest in time.