HOIDiffusion: Generating Realistic 3D Hand-Object Interaction Data

Understand

3D hand-object interaction data is scarce due to the hardware constraints in scaling up the data collection process.

• In this paper, we propose HOIDiffusion for generating realistic and diverse 3D hand-object interaction data.
• Our model is a conditional diffusion model that takes both the 3D hand-object geometric structure and text description as inputs for image synthesis.
• This offers a more controllable and realistic synthesis as we can specify the structure and style inputs in a disentangled manner.