Face2Face: Real-time Face Capture and Reenactment of RGB Videos

Understand

We present Face2Face, a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video).

• The source sequence is also a monocular video stream, captured live with a commodity webcam.
• Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion.
• To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling.