PlaNeRF: SVD Unsupervised 3D Plane Regularization for NeRF Large-Scale Scene Reconstruction

Understand

Neural Radiance Fields (NeRF) enable 3D scene reconstruction from 2D images and camera poses for Novel View Synthesis (NVS).

• Although NeRF can produce photorealistic results, it often suffers from overfitting to training views, leading to poor geometry reconstruction, especially in low-texture areas.
• This limitation restricts many important applications which require accurate geometry, such as extrapolated NVS, HD mapping and scene editing.
• To address this limitation, we propose a new method to improve NeRF's 3D structure using only RGB images and semantic maps.