Fetching the paper…
Reading the bibliography…
This paper presents a 3D Gaussian Inverse Rendering (GIR) method, employing 3D Gaussian representations to effectively factorize the scene into material properties, light, and geometry.
C. Csuri, R. Hackathorn, R. Parent, W. Carlson, and M. Howard, “Towards an interactive high visual complexity animation system,” Acm Siggraph Computer Graphics , vol. 13, no. 2, pp. 289–299, 1979
1979
Earlier work this paper cites.
M. Levoy and T. Whitted, “The use of points as a display primitive,” 1985
1985
Earlier work this paper cites.
C. Schlick, “An inexpensive brdf model for physically-based rendering,” in Computer graphics forum , vol. 13, no. 3. Wiley Online Library, 1994, pp. 233–246
1994
Earlier work this paper cites.
Y. Sato, M. D. Wheeler, and K. Ikeuchi, “Object shape and reflectance modeling from observation,” in SIGGRAPH , 1997, pp. 379–387
1997
Earlier work this paper cites.
S. R. Marschner, Inverse rendering for computer graphics . Cornell University, 1998
1998
Earlier work this paper cites.
Y. Yu, P. Debevec, J. Malik, and T. Hawkins, “Inverse global illumination: Recovering reflectance models of real scenes from photographs,” in Proceedings of the 26th annual conference on Computer graphics and interactive techniques , 1999, pp. 215–224
1999
Earlier work this paper cites.
R. Ramamoorthi and P. Hanrahan, “A signal-processing framework for inverse rendering,” in SIGGRAPH , 2001, pp. 117–128
2001
Earlier work this paper cites.
R. Ramamoorthi and P. Hanrahan, “An efficient representation for irradiance environment maps,” in Proceedings of the 28th annual conference on Computer graphics and interactive techniques , 2001, pp. 497–500
2001
Earlier work this paper cites.
R. Basri and D. W. Jacobs, “Lambertian reflectance and linear subspaces,” IEEE Trans. Pattern Anal. Mach. Intell. , vol. 25, no. 2, pp. 218–233, 2003
2003
Earlier work this paper cites.
P. Debevec, C. Tchou, A. Gardner, T. Hawkins, C. Poullis, J. Stumpfel, A. Jones, N. Yun, P. Einarsson, T. Lundgren et al. , “Estimating surface reflectance properties of a complex scene under captured natural illumination,” ACM Transactions on Graphics , vol. 19, p. 2, 2004
2004
Earlier work this paper cites.
B. Walter, S. R. Marschner, H. Li, and K. E. Torrance, “Microfacet models for refraction through rough surfaces,” in Proceedings of the 18th Eurographics conference on Rendering Techniques , 2007, pp. 195–206
2007
Earlier work this paper cites.
J. Wang, P. Ren, M. Gong, J. Snyder, and B. Guo, “All-frequency rendering of dynamic, spatially-varying reflectance,” in ACM SIGGRAPH Asia 2009 papers , 2009, pp. 1–10
2009
Earlier work this paper cites.
B. Burley, “Physically-based shading at disney,” in Acm Siggraph , vol. 2012. vol. 2012, 2012, pp. 1–7
2012
Earlier work this paper cites.
B. Karis and E. Games, “Real shading in unreal engine 4,” Proc. Physically Based Shading Theory Practice , vol. 4, no. 3, p. 1, 2013
2013
Earlier work this paper cites.
J. L. Schönberger and J.-M. Frahm, “Structure-from-motion revisited,” in Conference on Computer Vision and Pattern Recognition (CVPR) , 2016
2016
Earlier work this paper cites.
D. Ulyanov, A. Vedaldi, and V. Lempitsky, “Deep image prior,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2018, pp. 9446–9454
2018
Earlier work this paper cites.
H. Zhan, R. Garg, C. S. Weerasekera, K. Li, H. Agarwal, and I. Reid, “Unsupervised learning of monocular depth estimation and visual odometry with deep feature reconstruction,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2018, pp. 340–349
2018
Earlier work this paper cites.
W. Yifan, F. Serena, S. Wu, C. Öztireli, and O. Sorkine-Hornung, “Differentiable surface splatting for point-based geometry processing,” ACM Transactions on Graphics (TOG) , vol. 38, no. 6, pp. 1–14, 2019
2019
Earlier work this paper cites.
K.-A. Aliev, A. Sevastopolsky, M. Kolos, D. Ulyanov, and V. Lempitsky, “Neural point-based graphics,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXII 16 . Springer, 2020, pp. 696–712
2020
Earlier work this paper cites.
B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng, “Nerf: Representing scenes as neural radiance fields for view synthesis,” Communications of the ACM , vol. 65, no. 1, pp. 99–106, 2021
2021
Earlier work this paper cites.
J. T. Barron, B. Mildenhall, M. Tancik, P. Hedman, R. Martin-Brualla, and P. P. Srinivasan, “Mip-nerf: A multiscale representation for anti-aliasing neural radiance fields,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2021, pp. 5855–5864
2021
Earlier work this paper cites.
M. Oechsle, S. Peng, and A. Geiger, “Unisurf: Unifying neural implicit surfaces and radiance fields for multi-view reconstruction,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2021, pp. 5589–5599
2021
Cited alongside, same era.
L. Yariv, J. Gu, Y. Kasten, and Y. Lipman, “Volume rendering of neural implicit surfaces,” Adv. Neural Inform. Process. Syst. , vol. 34, pp. 4805–4815, 2021
2021
Cited alongside, same era.
P. Wang, L. Liu, Y. Liu, C. Theobalt, T. Komura, and W. Wang, “Neus: Learning neural implicit surfaces by volume rendering for multi-view reconstruction,” in Adv. Neural Inform. Process. Syst. , 2021
2021
Cited alongside, same era.
M. Mihajlovic, S. Weder, M. Pollefeys, and M. R. Oswald, “Deepsurfels: Learning online appearance fusion,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2021, pp. 14 524–14 535
2021
Cited alongside, same era.
Y. Zhang, J. Sun, X. He, H. Fu, R. Jia, and X. Zhou, “Modeling indirect illumination for inverse rendering,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2022
2022
Later among the works it cites.
Y. Liu, P. Wang, C. Lin, X. Long, J. Wang, L. Liu, T. Komura, and W. Wang, “Nero: Neural geometry and brdf reconstruction of reflective objects from multiview images,” ACM Trans. Graph. , 2023
2023
Closest in time.
B. Kerbl, G. Kopanas, T. Leimkühler, and G. Drettakis, “3d gaussian splatting for real-time radiance field rendering,” ACM Trans. Graph. , vol. 42, no. 4, pp. 1–14, 2023
2023
Closest in time.
J. T. Barron, B. Mildenhall, D. Verbin, P. P. Srinivasan, and P. Hedman, “Zip-nerf: Anti-aliased grid-based neural radiance fields,” in Int. Conf. Comput. Vis. , 2023
2023
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
P. P. Srinivasan, B. Deng, X. Zhang, M. Tancik, B. Mildenhall, and J. T. Barron, “Nerv: Neural reflectance and visibility fields for relighting and view synthesis,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2021, pp. 7495–7504
2021
Cited alongside, same era.
X. Zhang, P. P. Srinivasan, B. Deng, P. Debevec, W. T. Freeman, and J. T. Barron, “Nerfactor: Neural factorization of shape and reflectance under an unknown illumination,” ACM Trans. Graph. , vol. 40, no. 6, pp. 1–18, 2021
2021
Cited alongside, same era.
K. Zhang, F. Luan, Q. Wang, K. Bala, and N. Snavely, “Physg: Inverse rendering with spherical gaussians for physics-based material editing and relighting,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2021, pp. 5453–5462
2021
Cited alongside, same era.
M. Boss, R. Braun, V. Jampani, J. T. Barron, C. Liu, and H. P. Lensch, “Nerd: Neural reflectance decomposition from image collections,” in Int. Conf. Comput. Vis. , 2021
2021
Cited alongside, same era.
M. Boss, V. Jampani, R. Braun, C. Liu, J. Barron, and H. Lensch, “Neural-pil: Neural pre-integrated lighting for reflectance decomposition,” in Adv. Neural Inform. Process. Syst. , vol. 34, 2021, pp. 10 691–10 704
2021
Cited alongside, same era.
T. Shen, J. Gao, K. Yin, M.-Y. Liu, and S. Fidler, “Deep marching tetrahedra: a hybrid representation for high-resolution 3d shape synthesis,” Advances in Neural Information Processing Systems , vol. 34, pp. 6087–6101, 2021
2021
Cited alongside, same era.
J. Munkberg, J. Hasselgren, T. Shen, J. Gao, W. Chen, A. Evans, T. Müller, and S. Fidler, “Extracting triangular 3d models, materials, and lighting from images,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2022, pp. 8280–8290
2022
Cited alongside, same era.
J. Hasselgren, N. Hofmann, and J. Munkberg, “Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoising,” in Adv. Neural Inform. Process. Syst. , 2022
2022
Cited alongside, same era.
2023
Closest in time.
A. Mai, D. Verbin, F. Kuester, and S. Fridovich-Keil, “Neural microfacet fields for inverse rendering,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 408–418
2023
Closest in time.
J. Zhang, Y. Yao, S. Li, J. Liu, T. Fang, D. McKinnon, Y. Tsin, and L. Quan, “Neilf++: Inter-reflectable light fields for geometry and material estimation,” in Int. Conf. Comput. Vis. , 2023
2023
Closest in time.
R. Liang, H. Chen, C. Li, F. Chen, S. Panneer, and N. Vijaykumar, “Envidr: Implicit differentiable renderer with neural environment lighting,” in Int. Conf. Comput. Vis. , 2023
2023
Closest in time.
2023
Closest in time.
2023
Closest in time.
C. Zeng, G. Chen, Y. Dong, P. Peers, H. Wu, and X. Tong, “Relighting neural radiance fields with shadow and highlight hints,” in ACM Trans. Graph. , 2023, pp. 1–11
2023
Closest in time.
L. Lyu, A. Tewari, M. Habermann, S. Saito, M. Zollhöfer, T. Leimkühler, and C. Theobalt, “Diffusion posterior illumination for ambiguity-aware inverse rendering,” ACM Trans. Graph. , vol. 42, no. 6, pp. 1–14, 2023
2023
Closest in time.
C. Sun, G. Cai, Z. Li, K. Yan, C. Zhang, C. Marshall, J.-B. Huang, S. Zhao, and Z. Dong, “Neural-pbir reconstruction of shape, material, and illumination,” in Int. Conf. Comput. Vis. , 2023, pp. 18 046–18 056
2023
Closest in time.
2023
Closest in time.
2023
Closest in time.
2023
Closest in time.
H. Wu, Z. Hu, L. Li, Y. Zhang, C. Fan, and X. Yu, “Nefii: Inverse rendering for reflectance decomposition with near-field indirect illumination,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2023, pp. 4295–4304
2023
Closest in time.
J. Luiten, G. Kopanas, B. Leibe, and D. Ramanan, “Dynamic 3d gaussians: Tracking by persistent dynamic view synthesis,” in Proc. of the Intl. Conf. on 3D Vision (3DV) , 2024
2024
Closest in time.
J. Tang, J. Ren, H. Zhou, Z. Liu, and G. Zeng, “Dreamgaussian: Generative gaussian splatting for efficient 3d content creation,” Int. Conf. Learn. Represent. , 2024
2024
Closest in time.
B. Ummenhofer, S. Agrawal, R. Sepúlveda, Y. Lao, K. Zhang, T. Cheng, S. R. Richter, S. Wang, and G. Ros, “Objects with lighting: A real-world dataset for evaluating reconstruction and rendering for object relighting,” in 3DV . IEEE, 2024
2024
Closest in time.