DisCoHead: Audio-and-Video-Driven Talking Head Generation by Disentangled Control of Head Pose and Facial Expressions

Understand

For realistic talking head generation, creating natural head motion while maintaining accurate lip synchronization is essential.

• To fulfill this challenging task, we propose DisCoHead, a novel method to disentangle and control head pose and facial expressions without supervision.
• DisCoHead uses a single geometric transformation as a bottleneck to isolate and extract head motion from a head-driving video.
• Either an affine or a thin-plate spline transformation can be used and both work well as geometric bottlenecks.