Modeling Clothing as a Separate Layer for an Animatable Human Avatar

Understand

We have recently seen great progress in building photorealistic animatable full-body codec avatars, but generating high-fidelity animation of clothing is still difficult.

• To address these difficulties, we propose a method to build an animatable clothed body avatar with an explicit representation of the clothing on the upper body from multi-view captured videos.
• We use a two-layer mesh representation to register each 3D scan separately with the body and clothing templates.
• In order to improve the photometric correspondence across different frames, texture alignment is then performed through inverse rendering of the clothing geometry and texture predicted by a variational autoencoder.