Unifying Appearance Codes and Bilateral Grids for Driving Scene Gaussian Splatting

Understand

Neural rendering techniques, including NeRF and Gaussian Splatting (GS), rely on photometric consistency to produce high-quality reconstructions.

• However, in real-world scenarios, it is challenging to guarantee perfect photometric consistency in acquired images.
• Appearance codes have been widely used to address this issue, but their modeling capability is limited, as a single code is applied to the entire image.
• Recently, the bilateral grid was introduced to perform pixel-wise color mapping, but it is difficult to optimize and constrain effectively.