SimulCap : Single-View Human Performance Capture with Cloth Simulation

Understand

This paper proposes a new method for live free-viewpoint human performance capture with dynamic details (e.g., cloth wrinkles) using a single RGBD camera.

• Our main contributions are: (i) a multi-layer representation of garments and body, and (ii) a physics-based performance capture procedure.
• We first digitize the performer using multi-layer surface representation, which includes the undressed body surface and separate clothing meshes.
• For performance capture, we perform skeleton tracking, cloth simulation, and iterative depth fitting sequentially for the incoming frame.