Fetching the paper…
Reading the bibliography…
Crafting a single, versatile physics-based controller that can breathe life into interactive characters across a wide spectrum of scenarios represents an exciting frontier in character animation.
Asynchronous methods for deep reinforcement learning. In International conference on machine learning . PMLR, 1928–1937
Volodymyr Mnih, Adria Puigdomenech Badia, Mehdi Mirza, Alex Graves, Timothy Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. 2016 · 1937
Earlier work this paper cites.
Practical parameterization of rotations using the exponential map
F Sebastian Grassia. 1998 · 1998
Earlier work this paper cites.
Simulation of Human Motion Data using Short-Horizon Model-Predictive Control
Marco Silva, Yeuhi Abe, and Jovan Popovic. 2008 · 2008
Earlier work this paper cites.
Feature-Based Locomotion Controllers
Martin de Lasa, Igor Mordatch, and Aaron Hertzmann. 2010 · 2010
Earlier work this paper cites.
Data-Driven Biped Control
Yoonsang Lee, Sungeun Kim, and Jehee Lee. 2010a · 2010
Earlier work this paper cites.
Data-driven biped control
Yoonsang Lee, Sungeun Kim, and Jehee Lee. 2010b · 2010
Earlier work this paper cites.
Sampling-based Contact-rich Motion Control
Libin Liu, KangKang Yin, Michiel van de Panne, Tianjia Shao, and Weiwei Xu. 2010 · 2010
Earlier work this paper cites.
A reduction of imitation learning and structured prediction to no-regret online learning. In Proceedings of the fourteenth international conference on artificial intelligence and statistics . JMLR Workshop and Conference Proceedings, 627–635
Stéphane Ross, Geoffrey Gordon, and Drew Bagnell. 2011 · 2011
Earlier work this paper cites.
Flexible Muscle-Based Locomotion for Bipedal Creatures
Thomas Geijtenbeek, Michiel van de Panne, and A. Frank van der Stappen. 2013 · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba. 2014 · 2014
Earlier work this paper cites.
High-dimensional continuous control using generalized advantage estimation
John Schulman, Philipp Moritz, Sergey Levine, Michael Jordan, and Pieter Abbeel. 2015 · 2015
Earlier work this paper cites.
beta-vae: Learning basic visual concepts with a constrained variational framework. In International conference on learning representations
Irina Higgins, Loic Matthey, Arka Pal, Christopher Burgess, Xavier Glorot, Matthew Botvinick, Shakir Mohamed, and Alexander Lerchner. 2016 · 2016
Earlier work this paper cites.
Deep inertial poser: Learning to reconstruct human pose from sparse inertial measurements in real time
Yinghao Huang, Manuel Kaufmann, Emre Aksan, Michael J Black, Otmar Hilliges, and Gerard Pons-Moll. 2018 · 2018
Earlier work this paper cites.
Deepmimic: Example-guided deep reinforcement learning of physics-based character skills
Xue Bin Peng, Pieter Abbeel, Sergey Levine, and Michiel Van de Panne. 2018 · 2018
Earlier work this paper cites.
AMASS: Archive of Motion Capture as Surface Shapes. In International Conference on Computer Vision . 5442–5451
Naureen Mahmood, Nima Ghorbani, Nikolaus F. Troje, Gerard Pons-Moll, and Michael J. Black. 2019 · 2019
Earlier work this paper cites.
Unicon: Universal neural controller for physics-based character motion
Tingwu Wang, Yunrong Guo, Maria Shugrina, and Sanja Fidler. 2020 · 2020
Earlier work this paper cites.
Residual force control for agile human behavior imitation and extended motion synthesis
Ye Yuan and Kris Kitani. 2020 · 2020
Earlier work this paper cites.
Full-body motion from a single head-mounted device: Generating smpl poses from partial observations. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 11687–11697
Andrea Dittadi, Sebastian Dziadzio, Darren Cosker, Ben Lundell, Thomas J Cashman, and Jamie Shotton. 2021 · 2021
Earlier work this paper cites.
Stochastic scene-aware motion prediction. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 11374–11384
Mohamed Hassan, Duygu Ceylan, Ruben Villegas, Jun Saito, Jimei Yang, Yi Zhou, and Michael J Black. 2021 · 2021
Earlier work this paper cites.
Dynamics-regulated kinematic policy for egocentric pose estimation
Zhengyi Luo, Ryo Hachiuma, Ye Yuan, and Kris Kitani. 2021 · 2021
Earlier work this paper cites.
Isaac Gym: High Performance GPU Based Physics Simulation For Robot Learning. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2)
Viktor Makoviychuk, Lukasz Wawrzyniak, Yunrong Guo, Michelle Lu, Kier Storey, Miles Macklin, David Hoeller, Nikita Rudin, Arthur Allshire, Ankur Handa, and Gavriel State. 2021 · 2021
Cited alongside, same era.
Amp: Adversarial motion priors for stylized physics-based character control
Xue Bin Peng, Ze Ma, Pieter Abbeel, Sergey Levine, and Angjoo Kanazawa. 2021 · 2021
Cited alongside, same era.
Action-Conditioned 3D Human Motion Synthesis with Transformer VAE. In International Conference on Computer Vision (ICCV)
Mathis Petrovich, Michael J. Black, and Gül Varol. 2021 · 2021
Cited alongside, same era.
BABEL: Bodies, Action and Behavior with English Labels. In Proceedings IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR) . 722–731
Abhinanda R. Punnakkal, Arjun Chandrasekaran, Nikos Athanasiou, Alejandra Quiros-Ramirez, and Michael J. Black. 2021 · 2021
Cited alongside, same era.
Avatars grow legs: Generating smooth human motion from sparse tracking inputs with diffusion model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 481–490
Yuming Du, Robin Kips, Albert Pumarola, Sebastian Starke, Ali Thabet, and Artsiom Sanakoyeu. 2023 · 2023
Later among the works it cites.
Synthesizing physical character-scene interactions. In ACM SIGGRAPH 2023 Conference Proceedings . 1–9
Mohamed Hassan, Yunrong Guo, Tingwu Wang, Michael Black, Sanja Fidler, and Xue Bin Peng. 2023 · 2023
Later among the works it cites.
Questenvsim: Environment-aware simulated motion tracking from sparse sensors. In ACM SIGGRAPH 2023 Conference Proceedings . 1–9
Sunmin Lee, Sebastian Starke, Yuting Ye, Jungdam Won, and Alexander Winkler. 2023 · 2023
Later among the works it cites.
Perpetual humanoid control for real-time simulated avatars. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 10895–10904
Zhengyi Luo, Jinkun Cao, Kris Kitani, Weipeng Xu, et al · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Scene-aware generative network for human motion synthesis. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition . 12206–12215
Jingbo Wang, Sijie Yan, Bo Dai, and Dahua Lin. 2021 · 2021
Cited alongside, same era.
Lobstr: Real-time lower-body pose prediction from sparse upper-body tracking signals. In Computer Graphics Forum , Vol. 40. Wiley Online Library, 265–275
Dongseok Yang, Doyeon Kim, and Sung-Hee Lee. 2021 · 2021
Cited alongside, same era.
Stable Diffusion Prompt Book
Mohamad Diab, Julian Herrera, Bob Chernow, and Coco Mao. 2022 · 2022
Cited alongside, same era.
Motion In-betweening for Physically Simulated Characters
Deepak Gopinath, Hanbyul Joo, and Jungdam Won. 2022 · 2022
Cited alongside, same era.
Generating Diverse and Natural 3D Human Motions From Text. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 5152–5161
Chuan Guo, Shihao Zou, Xinxin Zuo, Sen Wang, Wei Ji, Xingyu Li, and Li Cheng. 2022 · 2022
Cited alongside, same era.
PADL: Language-Directed Physics-Based Character Control. In SIGGRAPH Asia 2022 Conference Papers (Daegu, Republic of Korea) (SA ’22) . Association for Computing Machinery, New York, NY, USA, Article 19, 9 pages
Jordan Juravsky, Yunrong Guo, Sanja Fidler, and Xue Bin Peng. 2022 · 2022
Cited alongside, same era.
Embodied scene-aware human pose estimation
Zhengyi Luo, Shun Iwase, Ye Yuan, and Kris Kitani. 2022a · 2022
Cited alongside, same era.
From Universal Humanoid Control to Automatic Physically Valid Character Creation
Zhengyi Luo, Ye Yuan, and Kris M Kitani. 2022b · 2022
Cited alongside, same era.
Eureka: Human-Level Reward Design via Coding Large Language Models. In The Twelfth International Conference on Learning Representations
Yecheng Jason Ma, William Liang, Guanzhi Wang, De-An Huang, Osbert Bastani, Dinesh Jayaraman, Yuke Zhu, Linxi Fan, and Anima Anandkumar. 2023 · 2023
Later among the works it cites.
Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 13756–13766
Davis Rempe, Zhengyi Luo, Xue Bin Peng, Ye Yuan, Kris Kitani, Karsten Kreis, Sanja Fidler, and Or Litany. 2023 · 2023
Later among the works it cites.
Calm: Conditional adversarial latent models for directable virtual characters. In ACM SIGGRAPH 2023 Conference Proceedings . 1–9
Chen Tessler, Yoni Kasten, Yunrong Guo, Shie Mannor, Gal Chechik, and Xue Bin Peng. 2023 · 2023
Later among the works it cites.
Physhoi: Physics-based imitation of dynamic human-object interaction
Yinhuai Wang, Jing Lin, Ailing Zeng, Zhengyi Luo, Jian Zhang, and Lei Zhang. 2023 · 2023
Later among the works it cites.
Interdiff: Generating 3d human-object interactions with physics-informed diffusion. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 14928–14940
Sirui Xu, Zhengyuan Li, Yu-Xiong Wang, and Liang-Yan Gui. 2023 · 2023
Later among the works it cites.
Learning physically simulated tennis skills from broadcast videos
Haotian Zhang, Ye Yuan, Viktor Makoviychuk, Yunrong Guo, Sanja Fidler, Xue Bin Peng, and Kayvon Fatahalian. 2023 · 2023
Later among the works it cites.
Synthesizing diverse human motions in 3d indoor scenes. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 14738–14749
Kaifeng Zhao, Yan Zhang, Shaofei Wang, Thabo Beeler, and Siyu Tang. 2023 · 2023
Later among the works it cites.
Realistic Full-Body Tracking from Sparse Observations via Joint-Level Modeling. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 14678–14688
Xiaozheng Zheng, Zhuo Su, Chao Wen, Zhou Xue, and Xiaojie Jin. 2023 · 2023
Later among the works it cites.
Neural Categorical Priors for Physics-Based Character Control
Qingxu Zhu, He Zhang, Mengting Lan, and Lei Han. 2023 · 2023
Later among the works it cites.
SuperPADL: Scaling Language-Directed Physics-Based Control with Progressive Supervised Distillation. In ACM SIGGRAPH 2024 Conference Papers . 1–11
Jordan Juravsky, Yunrong Guo, Sanja Fidler, and Xue Bin Peng. 2024 · 2024
Closest in time.
Universal Humanoid Motion Representations for Physics-Based Control. In The Twelfth International Conference on Learning Representations
Zhengyi Luo, Jinkun Cao, Josh Merel, Alexander Winkler, Jing Huang, Kris M. Kitani, and Weipeng Xu. 2024 · 2024
Closest in time.
Synthesizing physically plausible human motions in 3d scenes. In 2024 International Conference on 3D Vision (3DV) . IEEE, 1498–1507
Liang Pan, Jingbo Wang, Buzhen Huang, Junyu Zhang, Haofan Wang, Xu Tang, and Yangang Wang. 2024 · 2024
Closest in time.
Voyager: An Open-Ended Embodied Agent with Large Language Models
Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar. 2024b · 2024
Closest in time.
Unified Human-Scene Interaction via Prompted Chain-of-Contacts. In The Twelfth International Conference on Learning Representations
Zeqi Xiao, Tai Wang, Jingbo Wang, Jinkun Cao, Wenwei Zhang, Bo Dai, Dahua Lin, and Jiangmiao Pang. 2024 · 2024
Closest in time.
OmniControl: Control Any Joint at Any Time for Human Motion Generation. In The Twelfth International Conference on Learning Representations
Yiming Xie, Varun Jampani, Lei Zhong, Deqing Sun, and Huaizu Jiang. 2024 · 2024
Closest in time.