TPC: Test-time Procrustes Calibration for Diffusion-based Human Image Animation

Understand

Human image animation aims to generate a human motion video from the inputs of a reference human image and a target motion video.

• Current diffusion-based image animation systems exhibit high precision in transferring human identity into targeted motion, yet they still exhibit irregular quality in their outputs.
• Their optimal precision is achieved only when the physical compositions (i.e., scale and rotation) of the human shapes in the reference image and target pose frame are aligned.
• In the absence of such alignment, there is a noticeable decline in fidelity and consistency.