Monocular Dynamic View Synthesis: A Reality Check

Understand

We study the recent progress on dynamic view synthesis (DVS) from monocular video.

• Though existing approaches have demonstrated impressive results, we show a discrepancy between the practical capture process and the existing experimental protocols, which effectively leaks in multi-view signals during training.
• We define effective multi-view factors (EMFs) to quantify the amount of multi-view signal present in the input capture sequence based on the relative camera-scene motion.
• We introduce two new metrics: co-visibility masked image metrics and correspondence accuracy, which overcome the issue in existing protocols.