RaFE: Generative Radiance Fields Restoration

Understand

NeRF (Neural Radiance Fields) has demonstrated tremendous potential in novel view synthesis and 3D reconstruction, but its performance is sensitive to input image quality, which struggles to achieve high-fidelity rendering when provided with low-quality sparse input viewpoints.

• Previous methods for NeRF restoration are tailored for specific degradation type, ignoring the generality of restoration.
• To overcome this limitation, we propose a generic radiance fields restoration pipeline, named RaFE, which applies to various types of degradations, such as low resolution, blurriness, noise, compression artifacts, or their combinations.
• Our approach leverages the success of off-the-shelf 2D restoration methods to recover the multi-view images individually.