UrbanIR: Large-Scale Urban Scene Inverse Rendering from a Single Video

Understand

We present UrbanIR (Urban Scene Inverse Rendering), a new inverse graphics model that enables realistic, free-viewpoint renderings of scenes under various lighting conditions with a single video.

• It accurately infers shape, albedo, visibility, and sun and sky illumination from wide-baseline videos, such as those from car-mounted cameras, differing from NeRF's dense view settings.
• In this context, standard methods often yield subpar geometry and material estimates, such as inaccurate roof representations and numerous 'floaters'.
• UrbanIR addresses these issues with novel losses that reduce errors in inverse graphics inference and rendering artifacts.