Deep Video Portraits

Understand

We present a novel approach that enables photo-realistic re-animation of portrait videos using only an input video.

• In contrast to existing approaches that are restricted to manipulations of facial expressions only, we are the first to transfer the full 3D head position, head rotation, face expression, eye gaze, and eye blinking from a source actor to a portrait video of a target actor.
• The core of our approach is a generative neural network with a novel space-time architecture.
• The network takes as input synthetic renderings of a parametric face model, based on which it predicts photo-realistic video frames for a given target actor.