Fetching the paper…
Reading the bibliography…
Traditional approaches in physics-based motion generation, centered around imitation learning and reward shaping, often struggle to adapt to new scenarios.
Mujoco: A physics engine for model-based control
Emanuel Todorov, Tom Erez, and Yuval Tassa · 2012
Earlier work this paper cites.
Generative adversarial imitation learning
Jonathan Ho and Stefano Ermon · 2016
Earlier work this paper cites.
Proximal policy optimization algorithms
John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov · 2017
Earlier work this paper cites.
Neural probabilistic motor primitives for humanoid control
Josh Merel, Leonard Hasenclever, Alexandre Galashov, Arun Ahuja, Vu Pham, Greg Wayne, Yee Whye Teh, and Nicolas Heess · 2018
Earlier work this paper cites.
Deepmimic: Example-guided deep reinforcement learning of physics-based character skills
Xue Bin Peng, Pieter Abbeel, Sergey Levine, and Michiel Van de Panne · 2018
Earlier work this paper cites.
Human-centric indoor scene synthesis using stochastic grammar
Siyuan Qi, Yixin Zhu, Siyuan Huang, Chenfanfu Jiang, and Song-Chun Zhu · 2018
Earlier work this paper cites.
Multi-agent generative adversarial imitation learning
Jiaming Song, Hongyu Ren, Dorsa Sadigh, and Stefano Ermon · 2018
Earlier work this paper cites.
Holistic++ scene understanding: Single-view 3d holistic scene parsing and human pose estimation with human-object interaction and physical commonsense
Yixin Chen, Siyuan Huang, Tao Yuan, Siyuan Qi, Yixin Zhu, and Song-Chun Zhu · 2019
Earlier work this paper cites.
Mcp: Learning composable hierarchical control with multiplicative compositional policies
Xue Bin Peng, Michael Chang, Grace Zhang, Pieter Abbeel, and Sergey Levine · 2019
Earlier work this paper cites.
Stochastic latent actor-critic: Deep reinforcement learning with a latent variable model
Alex X Lee, Anusha Nagabandi, Pieter Abbeel, and Sergey Levine · 2020
Earlier work this paper cites.
Catch & carry: reusable neural controllers for vision-guided whole-body tasks
Josh Merel, Saran Tunyasuvunakool, Arun Ahuja, Yuval Tassa, Leonard Hasenclever, Vu Pham, Tom Erez, Greg Wayne, and Nicolas Heess · 2020
Earlier work this paper cites.
Understanding contrastive representation learning through alignment and uniformity on the hypersphere
Tongzhou Wang and Phillip Isola · 2020
Earlier work this paper cites.
A scalable approach to control diverse behaviors for physically simulated characters
Jungdam Won, Deepak Gopinath, and Jessica Hodgins · 2020
Earlier work this paper cites.
Generating 3d people in scenes without people
Yan Zhang, Mohamed Hassan, Heiko Neumann, Michael J Black, and Siyu Tang · 2020
Earlier work this paper cites.
Stochastic scene-aware motion prediction
Mohamed Hassan, Duygu Ceylan, Ruben Villegas, Jun Saito, Jimei Yang, Yi Zhou, and Michael J Black · 2021
Earlier work this paper cites.
Learning for a robot: Deep reinforcement learning, imitation learning, transfer learning
Jiang Hua, Liangcai Zeng, Gongfa Li, and Zhaojie Ju · 2021
Earlier work this paper cites.
Isaac gym: High performance gpu-based physics simulation for robot learning
Viktor Makoviychuk, Lukasz Wawrzyniak, Yunrong Guo, Michelle Lu, Kier Storey, Miles Macklin, David Hoeller, Nikita Rudin, Arthur Allshire, Ankur Handa, et al · 2021
Earlier work this paper cites.
Amp: Adversarial motion priors for stylized physics-based character control
Xue Bin Peng, Ze Ma, Pieter Abbeel, Sergey Levine, and Angjoo Kanazawa · 2021
Earlier work this paper cites.
Babel: Bodies, action and behavior with english labels
Abhinanda R Punnakkal, Arjun Chandrasekaran, Nikos Athanasiou, Alejandra Quiros-Ramirez, and Michael J Black · 2021
Earlier work this paper cites.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021
Cited alongside, same era.
Physics-based human motion estimation and synthesis from videos
Kevin Xie, Tingwu Wang, Umar Iqbal, Yunrong Guo, Sanja Fidler, and Florian Shkurti · 2021
Cited alongside, same era.
Videoclip: Contrastive pre-training for zero-shot video-text understanding
Hu Xu, Gargi Ghosh, Po-Yao Huang, Dmytro Okhonko, Armen Aghajanyan, Florian Metze, Luke Zettlemoyer, and Christoph Feichtenhofer · 2021
Cited alongside, same era.
Towards understanding mixture of experts in deep learning
Zixiang Chen, Yihe Deng, Yue Wu, Quanquan Gu, and Yuanzhi Li · 2022
Cited alongside, same era.
Differentiable dynamics for articulated 3d human motion reconstruction
Erik Gärtner, Mykhaylo Andriluka, Erwin Coumans, and Cristian Sminchisescu · 2022
Cited alongside, same era.
Full-body articulated human-object interaction
Nan Jiang, Tengyu Liu, Zhexuan Cao, Jieming Cui, Zhiyuan Zhang, Yixin Chen, He Wang, Yixin Zhu, and Siyuan Huang · 2023
Later among the works it cites.
Words into action: Learning diverse humanoid behaviors using language guided iterative motion refinement
K Niranjan Kumar, Irfan Essa, and Sehoon Ha · 2023
Later among the works it cites.
Locomotion-action-manipulation: Synthesizing human-scene interactions in complex 3d environments
Jiye Lee and Hanbyul Joo · 2023
Later among the works it cites.
Introducing gpt-4
OpenAI · 2023
Later among the works it cites.
Diffusion motion: Generate text-guided 3d human motion by diffusion model
Zhiyuan Ren, Zhihong Pan, Xin Zhou, and Le Kang · 2023
Later among the works it cites.
Vision-language models are zero-shot reward models for reinforcement learning
Juan Rocamonde, Victoriano Montesinos, Elvis Nava, Ethan Perez, and David Lindner · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Generating diverse and natural 3d human motions from text
Chuan Guo, Shihao Zou, Xinxin Zuo, Sen Wang, Wei Ji, Xingyu Li, and Li Cheng · 2022
Cited alongside, same era.
Avatarclip: Zero-shot text-driven generation and animation of 3d avatars
Fangzhou Hong, Mingyuan Zhang, Liang Pan, Zhongang Cai, Lei Yang, and Ziwei Liu · 2022
Cited alongside, same era.
Padl: Language-directed physics-based character control
Jordan Juravsky, Yunrong Guo, Sanja Fidler, and Xue Bin Peng · 2022
Cited alongside, same era.
Sai Shashank Kalakonda, Shubh Maheshwari, and Ravi Kiran Sarvadevabhatla · 2022
Cited alongside, same era.
Humanoid self-collision avoidance using whole-body control with control barrier functions
Charles Khazoom, Daniel Gonzalez-Diaz, Yanran Ding, and Sangbae Kim · 2022
Cited alongside, same era.
Coap: Compositional articulated occupancy of people
Marko Mihajlovic, Shunsuke Saito, Aayush Bansal, Michael Zollhoefer, and Siyu Tang · 2022
Cited alongside, same era.
Ase: Large-scale reusable adversarial skill embeddings for physically simulated characters
Xue Bin Peng, Yunrong Guo, Lina Halper, Sergey Levine, and Sanja Fidler · 2022
Cited alongside, same era.
Later among the works it cites.
SFU Motion Capture Database
SFU MOCAP · 2023
Later among the works it cites.
Calm: Conditional adversarial latent models for directable virtual characters
Chen Tessler, Yoni Kasten, Yunrong Guo, Shie Mannor, Gal Chechik, and Xue Bin Peng · 2023
Later among the works it cites.
Recovering 3d human mesh from monocular images: A survey
Yating Tian, Hongwen Zhang, Yebin Liu, and Limin Wang · 2023
Later among the works it cites.
3d human pose estimation via intuitive physics
Shashank Tripathi, Lea Müller, Chun-Hao P Huang, Omid Taheri, Michael J Black, and Dimitrios Tzionas · 2023
Later among the works it cites.
Edge: Editable dance generation from music
Jonathan Tseng, Rodrigo Castellon, and Karen Liu · 2023
Later among the works it cites.
Mime: Human-aware 3d scene generation
Hongwei Yi, Chun-Hao P Huang, Shashank Tripathi, Lea Hering, Justus Thies, and Michael J Black · 2023
Later among the works it cites.
Physdiff: Physics-guided human motion diffusion model
Ye Yuan, Jiaming Song, Umar Iqbal, Arash Vahdat, and Jan Kautz · 2023
Later among the works it cites.
Synthesizing diverse human motions in 3d indoor scenes
Kaifeng Zhao, Yan Zhang, Shaofei Wang, Thabo Beeler, and Siyu Tang · 2023
Later among the works it cites.
Probio: A protocol-guided multimodal dataset for molecular biology lab
Jieming Cui, Ziren Gong, Baoxiong Jia, Siyuan Huang, Zilong Zheng, Jianzhu Ma, and Yixin Zhu · 2024
Closest in time.
Motiongpt: Human motion as a foreign language
Biao Jiang, Xin Chen, Wen Liu, Jingyi Yu, Gang Yu, and Tao Chen · 2024
Closest in time.
Move as you say, interact as you can: Language-guided human motion generation with scene affordance
Zan Wang, Yixin Chen, Baoxiong Jia, Puhao Li, Jinlu Zhang, Jingze Zhang, Tengyu Liu, Yixin Zhu, Wei Liang, and Siyuan Huang · 2024
Closest in time.
Test-time adaptation with CLIP reward for zero-shot generalization in vision-language models
Shuai Zhao, Xiaohan Wang, Linchao Zhu, and Yi Yang · 2024
Closest in time.