SPACE: Speech-driven Portrait Animation with Controllable Expression

Understand

Animating portraits using speech has received growing attention in recent years, with various creative and practical use cases.

• An ideal generated video should have good lip sync with the audio, natural facial expressions and head motions, and high frame quality.
• In this work, we present SPACE, which uses speech and a single image to generate high-resolution, and expressive videos with realistic head pose, without requiring a driving video.
• It uses a multi-stage approach, combining the controllability of facial landmarks with the high-quality synthesis power of a pretrained face generator.