Autonomous Character-Scene Interaction Synthesis from Text Instruction

Generalized biped walking control

Stelian Coros, Philippe Beaudoin, and Michiel Van de Panne. 2010 · 2010

Earlier work this paper cites.

Discovery of complex behaviors through contact-invariant optimization

Igor Mordatch, Emanuel Todorov, and Zoran Popović. 2012 · 2012

Earlier work this paper cites.

Pigraphs: learning interaction snapshots from observations

Manolis Savva, Angel X Chang, Pat Hanrahan, Matthew Fisher, and Matthias Nießner. 2016 · 2016

Earlier work this paper cites.

Learning to schedule control fragments for physics-based characters using deep q-learning

Libin Liu and Jessica Hodgins. 2017 · 2017

Earlier work this paper cites.

Attention is all you need. In Advances in Neural Information Processing Systems (NeurIPS)

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Learning basketball dribbling skills using trajectory optimization and deep reinforcement learning

Libin Liu and Jessica Hodgins. 2018 · 2018

Earlier work this paper cites.

Recovering Accurate 3D Human Pose in The Wild Using IMUs and a Moving Camera. In European Conference on Computer Vision (ECCV)

Timo von Marcard, Roberto Henschel, Michael Black, Bodo Rosenhahn, and Gerard Pons-Moll. 2018 · 2018

Earlier work this paper cites.

Resolving 3D human pose ambiguities with 3D scene constraints. In International Conference on Computer Vision (ICCV)

Mohamed Hassan, Vasileios Choutas, Dimitrios Tzionas, and Michael J Black. 2019 · 2019

Earlier work this paper cites.

Putting humans in a scene: Learning affordance in 3d indoor environments. In Conference on Computer Vision and Pattern Recognition (CVPR)

Xueting Li, Sifei Liu, Kihwan Kim, Xiaolong Wang, Ming-Hsuan Yang, and Jan Kautz. 2019 · 2019

Earlier work this paper cites.

iMapper: interaction-guided scene mapping from monocular videos

Aron Monszpart, Paul Guerrero, Duygu Ceylan, Ersin Yumer, and Niloy J Mitra. 2019 · 2019

Earlier work this paper cites.

Expressive body capture: 3d hands, face, and body from a single image. In Conference on Computer Vision and Pattern Recognition (CVPR)

Georgios Pavlakos, Vasileios Choutas, Nima Ghorbani, Timo Bolkart, Ahmed AA Osman, Dimitrios Tzionas, and Michael J Black. 2019 · 2019

Earlier work this paper cites.

Mcp: Learning composable hierarchical control with multiplicative compositional policies. In Advances in Neural Information Processing Systems (NeurIPS)

Xue Bin Peng, Michael Chang, Grace Zhang, Pieter Abbeel, and Sergey Levine. 2019 · 2019

Earlier work this paper cites.

Neural state machine for character-scene interactions

Sebastian Starke, He Zhang, Taku Komura, and Jun Saito. 2019 · 2019

Earlier work this paper cites.

Denoising diffusion probabilistic models. In Advances in Neural Information Processing Systems (NeurIPS)

Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020 · 2020

Earlier work this paper cites.

Catch & carry: reusable neural controllers for vision-guided whole-body tasks

Josh Merel, Saran Tunyasuvunakool, Arun Ahuja, Yuval Tassa, Leonard Hasenclever, Vu Pham, Tom Erez, Greg Wayne, and Nicolas Heess. 2020 · 2020

Cited alongside, same era.

GRAB: A dataset of whole-body human grasping of objects. In European Conference on Computer Vision (ECCV)

Omid Taheri, Nima Ghorbani, Michael J Black, and Dimitrios Tzionas. 2020 · 2020

Cited alongside, same era.

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In International Conference on Learning Representations (ICLR)

Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. 2021 · 2021

Cited alongside, same era.

Stochastic Scene-Aware Motion Prediction. In International Conference on Computer Vision (ICCV)

Mohamed Hassan, Duygu Ceylan, Ruben Villegas, Jun Saito, Jimei Yang, Yi Zhou, and Michael Black. 2021 · 2021

Cited alongside, same era.

Learning transferable visual models from natural language supervision. In International Conference on Machine Learning (ICML)

ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation. In Conference on Computer Vision and Pattern Recognition (CVPR)

Zicong Fan, Omid Taheri, Dimitrios Tzionas, Muhammed Kocabas, Manuel Kaufmann, Michael J. Black, and Otmar Hilliges. 2023 · 2023

Later among the works it cites.

IMoS: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactions. In Eurographics

Anindita Ghosh, Rishabh Dabral, Vladislav Golyanik, Christian Theobalt, and Philipp Slusallek. 2023 · 2023

Later among the works it cites.

Interaction Replica: Tracking human–object interaction and scene changes from human motion. In International Conference on 3D Vision (3DV)

Vladimir Guzov, Julian Chibane, Riccardo Marin, Yannan He, Yunus Saracoglu, Torsten Sattler, and Gerard Pons-Moll. 2023 · 2023

Later among the works it cites.

Synthesizing Physical Character-Scene Interactions. In SIGGRAPH Conference Papers

Mohamed Hassan, Yunrong Guo, Tingwu Wang, Michael Black, Sanja Fidler, and Xue Bin Peng. 2023 · 2023

Later among the works it cites.

Diffusion-based Generation, Optimization, and Planning in 3D Scenes. In Conference on Computer Vision and Pattern Recognition (CVPR)