StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting

Understand

We introduce StyleGaussian, a novel 3D style transfer technique that allows instant transfer of any image's style to a 3D scene at 10 frames per second (fps).

• Leveraging 3D Gaussian Splatting (3DGS), StyleGaussian achieves style transfer without compromising its real-time rendering ability and multi-view consistency.
• It achieves instant style transfer with three steps: embedding, transfer, and decoding.
• Initially, 2D VGG scene features are embedded into reconstructed 3D Gaussians.