Grounding 3D Object Affordance from 2D Interactions in Images

Understand

Grounding 3D object affordance seeks to locate objects' ''action possibilities'' regions in the 3D space, which serves as a link between perception and operation for embodied agents.

• Existing studies primarily focus on connecting visual affordances with geometry structures, e.g.
• relying on annotations to declare interactive regions of interest on the object and establishing a mapping between the regions and affordances.
• However, the essence of learning object affordance is to understand how to use it, and the manner that detaches interactions is limited in generalization.