Learning Physics-guided Face Relighting under Directional Light

Understand

Relighting is an essential step in realistically transferring objects from a captured image into another environment.

• For example, authentic telepresence in Augmented Reality requires faces to be displayed and relit consistent with the observer's scene lighting.
• We investigate end-to-end deep learning architectures that both de-light and relight an image of a human face.
• Our model decomposes the input image into intrinsic components according to a diffuse physics-based image formation model.