VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation

Understand

Human image animation involves generating a video from a static image by following a specified pose sequence.

• Current approaches typically adopt a multi-stage pipeline that separately learns appearance and motion, which often leads to appearance degradation and temporal inconsistencies.
• To address these issues, we propose VividPose, an innovative end-to-end pipeline based on Stable Video Diffusion (SVD) that ensures superior temporal stability.
• To enhance the retention of human identity, we propose an identity-aware appearance controller that integrates additional facial information without compromising other appearance details such as clothing texture and background.