Joint Reconstruction of 3D Human and Object via Contact-Based Refinement Transformer

Understand

Human-object contact serves as a strong cue to understand how humans physically interact with objects.

• Nevertheless, it is not widely explored to utilize human-object contact information for the joint reconstruction of 3D human and object from a single image.
• In this work, we present a novel joint 3D human-object reconstruction method (CONTHO) that effectively exploits contact information between humans and objects.
• There are two core designs in our system: 1) 3D-guided contact estimation and 2) contact-based 3D human and object refinement.