Make-Your-Anchor: A Diffusion-based 2D Avatar Generation Framework

Understand

Despite the remarkable process of talking-head-based avatar-creating solutions, directly generating anchor-style videos with full-body motions remains challenging.

• In this study, we propose Make-Your-Anchor, a novel system necessitating only a one-minute video clip of an individual for training, subsequently enabling the automatic generation of anchor-style videos with precise torso and hand movements.
• Specifically, we finetune a proposed structure-guided diffusion model on input video to render 3D mesh conditions into human appearances.
• We adopt a two-stage training strategy for the diffusion model, effectively binding movements with specific appearances.