Unified Human-Scene Interaction via Prompted Chain-of-Contacts

Understand

Human-Scene Interaction (HSI) is a vital component of fields like embodied AI and virtual reality.

• Despite advancements in motion quality and physical plausibility, two pivotal factors, versatile interaction control and the development of a user-friendly interface, require further exploration before the practical application of HSI.
• This paper presents a unified HSI framework, UniHSI, which supports unified control of diverse interactions through language commands.
• This framework is built upon the definition of interaction as Chain of Contacts (CoC): steps of human joint-object part pairs, which is inspired by the strong correlation between interaction types and human-object contact regions.