Zero-Shot Human-Object Interaction Synthesis with Multimodal Priors

Understand

Human-object interaction (HOI) synthesis is important for various applications, ranging from virtual reality to robotics.

• However, acquiring 3D HOI data is challenging due to its complexity and high cost, limiting existing methods to the narrow diversity of object types and interaction patterns in training datasets.
• This paper proposes a novel zero-shot HOI synthesis framework without relying on end-to-end training on currently limited 3D HOI datasets.
• The core idea of our method lies in leveraging extensive HOI knowledge from pre-trained Multimodal Models.