Fetching the paper…
Reading the bibliography…
This paper tackles the challenge of creating relightable and animatable neural avatars from sparse-view (or even monocular) videos of dynamic humans under unknown illumination.
The rendering equation
James T Kajiya · 1986
Earlier work this paper cites.
Sphere tracing: Simple robust antialiased rendering of distance-based implicit surfaces
John C Hart et al · 1993
Earlier work this paper cites.
Nearest neighbor queries
Nick Roussopoulos, Stephen Kelley, and Frederic Vincent · 1995
Earlier work this paper cites.
Sphere tracing: A geometric method for the antialiased ray tracing of implicit surfaces
John C Hart · 1996
Earlier work this paper cites.
Virtualized reality: Constructing virtual worlds from real scenes
Takeo Kanade, Peter Rander, and PJ Narayanan · 1997
Earlier work this paper cites.
Single sample soft shadows
Steven Parker, Peter Shirley, and Brian Smits · 1998
Earlier work this paper cites.
Acquiring the reflectance field of a human face
Paul Debevec, Tim Hawkins, Chris Tchou, Haarm-Pieter Duiker, Westley Sarokin, and Mark Sagar · 2000
Earlier work this paper cites.
Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation
John P Lewis, Matt Cordner, and Nickson Fong · 2000
Earlier work this paper cites.
Free-viewpoint video of human actors
Joel Carranza, Christian Theobalt, Marcus A Magnor, and Hans-Peter Seidel · 2003
Earlier work this paper cites.
Studio production system for dynamic 3d content
Oliver Grau · 2003
Earlier work this paper cites.
Virtual view synthesis of people from multiple view video sequences
Jonathan Starck and Adrian Hilton · 2005
Earlier work this paper cites.
Performance relighting and reflectance transformation with time-multiplexed illumination
Andreas Wenger, Andrew Gardner, Chris Tchou, Jonas Unger, Tim Hawkins, and Paul Debevec · 2005
Earlier work this paper cites.
Surface capture for performance-based animation
Jonathan Starck and Adrian Hilton · 2007
Earlier work this paper cites.
Microfacet models for refraction through rough surfaces
Bruce Walter, Stephen R Marschner, Hongsong Li, and Kenneth E Torrance · 2007
Earlier work this paper cites.
Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography
Paul Debevec · 2008
Earlier work this paper cites.
Articulated mesh animation from multi-view silhouettes
Daniel Vlasic, Ilya Baran, Wojciech Matusik, and Jovan Popović · 2008
Earlier work this paper cites.
Creation of 3d human avatar using kinect
Kairat Aitpayev and Jaafar Gaber · 2012
Earlier work this paper cites.
The light stages and their applications to photoreal digital actors
Paul Debevec · 2012
Earlier work this paper cites.
Scanning 3d full human bodies using kinects
Jing Tong, Jin Zhou, Ligang Liu, Zhigeng Pan, and Hao Yan · 2012
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Rapid avatar capture and simulation using commodity depth sensors
Ari Shapiro, Andrew Feng, Ruizhe Wang, Hao Li, Mark Bolas, Gerard Medioni, and Evan Suma · 2014
Earlier work this paper cites.
Detailed full-body reconstructions of moving people from monocular rgb-d sequences
Federica Bogo, Michael J Black, Matthew Loper, and Javier Romero · 2015
Earlier work this paper cites.
High-quality streamable free-viewpoint video
Alvaro Collet, Ming Chuang, Pat Sweeney, Don Gillett, Dennis Evseev, David Calabrese, Hugues Hoppe, Adam Kirk, and Steve Sullivan · 2015
Earlier work this paper cites.
Smpl: A skinned multi-person linear model
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black · 2015
Earlier work this paper cites.
Structure-from-motion revisited
Johannes L Schonberger and Jan-Michael Frahm · 2016
Earlier work this paper cites.
Embodied hands: Modeling and capturing hands and bodies together
Javier Romero, Dimitrios Tzionas, and Michael J Black · 2017
Earlier work this paper cites.
Gpu-based clay simulation and ray-tracing tech in claybook
Sebastian Aaltonen · 2018
Earlier work this paper cites.
Video based reconstruction of 3d people models
Thiemo Alldieck, Marcus Magnor, Weipeng Xu, Christian Theobalt, and Gerard Pons-Moll · 2018
Cited alongside, same era.
Blender - a 3D modelling and rendering package
Blender Online Community · 2018
Cited alongside, same era.
Monoperfcap: Human performance capture from monocular video
Weipeng Xu, Avishek Chatterjee, Michael Zollhöfer, Helge Rhodin, Dushyant Mehta, Hans-Peter Seidel, and Christian Theobalt · 2018
Cited alongside, same era.
The unreasonable effectiveness of deep features as a perceptual metric
Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang · 2018
Cited alongside, same era.
Area lights in signed distance function scenes
Róbert Bán, Csaba Bálint, and Gábor Valasek · 2019
Cited alongside, same era.
The relightables: Volumetric performance capture of humans with realistic relighting
Kaiwen Guo, Peter Lincoln, Philip Davidson, Jay Busch, Xueming Yu, Matt Whalen, Geoff Harvey, Sergio Orts-Escolano, Rohit Pandey, Jason Dourgarian, et al · 2019
Nerv: Neural reflectance and visibility fields for relighting and view synthesis
Pratul P Srinivasan, Boyang Deng, Xiuming Zhang, Matthew Tancik, Ben Mildenhall, and Jonathan T Barron · 2021
Later among the works it cites.
H-nerf: Neural radiance fields for rendering and temporal reconstruction of humans in motion
Hongyi Xu, Thiemo Alldieck, and Cristian Sminchisescu · 2021
Later among the works it cites.
Volume rendering of neural implicit surfaces
Lior Yariv, Jiatao Gu, Yoni Kasten, and Yaron Lipman · 2021
Later among the works it cites.
Physg: Inverse rendering with spherical gaussians for physics-based material editing and relighting
Kai Zhang, Fujun Luan, Qianqian Wang, Kavita Bala, and Noah Snavely · 2021
Later among the works it cites.
Neural light transport for relighting and view synthesis
Xiuming Zhang, Sean Fanello, Yun-Ta Tsai, Tiancheng Sun, Tianfan Xue, Rohit Pandey, Sergio Orts-Escolano, Philip Davidson, Christoph Rhemann, Paul Debevec, et al · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Livecap: Real-time human performance capture from monocular video
Marc Habermann, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, and Christian Theobalt · 2019
Cited alongside, same era.
Relighting humans: occlusion-aware inverse rendering for full-body human images
Yoshihiro Kanamori and Yuki Endo · 2019
Cited alongside, same era.
Non-linear sphere tracing for rendering deformed signed distance fields
Dario Seyb, Alec Jacobson, Derek Nowrouzezahrai, and Wojciech Jarosz · 2019
Cited alongside, same era.
Implicit geometric regularization for learning shapes
Amos Gropp, Lior Yariv, Niv Haim, Matan Atzmon, and Yaron Lipman · 2020
Cited alongside, same era.
Deepcap: Monocular human performance capture using weak supervision
Marc Habermann, Weipeng Xu, Michael Zollhofer, Gerard Pons-Moll, and Christian Theobalt · 2020
Cited alongside, same era.
Arch: Animatable reconstruction of clothed humans
Zeng Huang, Yuanlu Xu, Christoph Lassner, Hao Li, and Tony Tung · 2020
Cited alongside, same era.
Nerfactor: Neural factorization of shape and reflectance under an unknown illumination
Xiuming Zhang, Pratul P Srinivasan, Boyang Deng, Paul Debevec, William T Freeman, and Jonathan T Barron · 2021
Later among the works it cites.
Photorealistic monocular 3d reconstruction of humans wearing clothing
Thiemo Alldieck, Mihai Zanfir, and Cristian Sminchisescu · 2022
Later among the works it cites.
Samurai: Shape and material from unconstrained real-world arbitrary image collections
Mark Boss, Andreas Engelhardt, Abhishek Kar, Yuanzhen Li, Deqing Sun, Jonathan T Barron, Hendrik Lensch, and Varun Jampani · 2022
Later among the works it cites.
Neural surface reconstruction of dynamic scenes with monocular rgb-d camera
Hongrui Cai, Wanquan Feng, Xuetao Feng, Yan Wang, and Juyong Zhang · 2022
Later among the works it cites.
L-tracing: Fast light visibility estimation on neural surfaces by sphere tracing
Ziyu Chen, Chenjing Ding, Jianfei Guo, Dongliang Wang, Yikang Li, Xuan Xiao, Wei Wu, and Li Song · 2022
Later among the works it cites.
Relighting4d: Neural relightable human from videos
Zhaoxi Chen and Ziwei Liu · 2022
Later among the works it cites.
Rana: Relightable articulated neural avatars
Umar Iqbal, Akin Caliskan, Koki Nagano, Sameh Khamis, Pavlo Molchanov, and Jan Kautz · 2022
Later among the works it cites.
Geometry-aware single-image full-body human relighting
Chaonan Ji, Tao Yu, Kaiwen Guo, Jingxin Liu, and Yebin Liu · 2022
Later among the works it cites.
Neuman: Neural human radiance field from a single video
Wei Jiang, Kwang Moo Yi, Golnoosh Samei, Oncel Tuzel, and Anurag Ranjan · 2022
Later among the works it cites.
Neroic: Neural rendering of objects from online image collections
Zhengfei Kuang, Kyle Olszewski, Menglei Chai, Zeng Huang, Panos Achlioptas, and Sergey Tulyakov · 2022
Later among the works it cites.
Robust high-resolution video matting with temporal guidance
Shanchuan Lin, Linjie Yang, Imran Saleemi, and Soumyadip Sengupta · 2022
Later among the works it cites.
Animatable implicit neural representations for creating realistic avatars from videos
Sida Peng, Zhen Xu, Junting Dong, Qianqian Wang, Shangzhan Zhang, Qing Shuai, Hujun Bao, and Xiaowei Zhou · 2022
Later among the works it cites.
Spelunking the deep: guaranteed queries on general neural implicit surfaces via range analysis
Nicholas Sharp and Alec Jacobson · 2022
Later among the works it cites.
Arah: Animatable volume rendering of articulated human sdfs
Shaofei Wang, Katja Schwarz, Andreas Geiger, and Siyu Tang · 2022
Later among the works it cites.
Humannerf: Free-viewpoint rendering of moving people from monocular video
Chung-Yi Weng, Brian Curless, Pratul P Srinivasan, Jonathan T Barron, and Ira Kemelmacher-Shlizerman · 2022
Later among the works it cites.
Learning to relight portrait images via a virtual light stage and synthetic-to-real adaptation
Yu-Ying Yeh, Koki Nagano, Sameh Khamis, Jan Kautz, Ming-Yu Liu, and Ting-Chun Wang · 2022
Later among the works it cites.
Modeling indirect illumination for inverse rendering
Yuanqing Zhang, Jiaming Sun, Xingyi He, Huan Fu, Rongfei Jia, and Xiaowei Zhou · 2022
Later among the works it cites.
Structured local radiance fields for human avatar modeling
Zerong Zheng, Han Huang, Tao Yu, Hongwen Zhang, Yandong Guo, and Yebin Liu · 2022
Later among the works it cites.
Poly Haven, 2023
2023
Closest in time.
Relightablehands: Efficient neural relighting of articulated hand models
Shun Iwase, Shunsuke Saito, Tomas Simon, Stephen Lombardi, Timur Bagautdinov, Rohan Joshi, Fabian Prada, Takaaki Shiratori, Yaser Sheikh, and Jason Saragih · 2023
Closest in time.
Megane: Morphable eyeglass and avatar network
Junxuan Li, Shunsuke Saito, Tomas Simon, Stephen Lombardi, Hongdong Li, and Jason Saragih · 2023
Closest in time.