GPT-Connect: Interaction between Text-Driven Human Motion Generator and 3D Scenes in a Training-free Manner

Understand

Recently, while text-driven human motion generation has received massive research attention, most existing text-driven motion generators are generally only designed to generate motion sequences in a blank background.

• While this is the case, in practice, human beings naturally perform their motions in 3D scenes, rather than in a blank background.
• Considering this, we here aim to perform scene-aware text-drive motion generation instead.
• Yet, intuitively training a separate scene-aware motion generator in a supervised way can require a large amount of motion samples to be troublesomely collected and annotated in a large scale of different 3D scenes.