Fetching the paper…
Reading the bibliography…
We introduce a free-viewpoint rendering method -- HumanNeRF -- that works on a given monocular video of a human performing complex body motions, e.g.
View interpolation for image synthesis
Shenchang Eric Chen and Lance Williams · 1993
Earlier work this paper cites.
Optical models for direct volume rendering
Nelson Max · 1995
Earlier work this paper cites.
Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach
Paul E Debevec, Camillo J Taylor, and Jitendra Malik · 1996
Earlier work this paper cites.
The lumigraph
Steven J Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F Cohen · 1996
Earlier work this paper cites.
Light field rendering
Marc Levoy and Pat Hanrahan · 1996
Earlier work this paper cites.
Virtualized reality: Constructing virtual worlds from real scenes
Takeo Kanade, Peter Rander, and PJ Narayanan · 1997
Earlier work this paper cites.
Image-based visual hulls
Wojciech Matusik, Chris Buehler, Ramesh Raskar, Steven J Gortler, and Leonard McMillan · 2000
Earlier work this paper cites.
Review of image-based rendering techniques
Harry Shum and Sing Bing Kang · 2000
Earlier work this paper cites.
Free-viewpoint video of human actors
Joel Carranza, Christian Theobalt, Marcus A Magnor, and Hans-Peter Seidel · 2003
Earlier work this paper cites.
High-quality video view interpolation using a layered representation
C Lawrence Zitnick, Sing Bing Kang, Matthew Uyttendaele, Simon Winder, and Richard Szeliski · 2004
Earlier work this paper cites.
Video-based character animation
Jonathan Starck, Gregor Miller, and Adrian Hilton · 2005
Earlier work this paper cites.
Performance capture from sparse multi-view video
Edilson De Aguiar, Carsten Stoll, Christian Theobalt, Naveed Ahmed, Hans-Peter Seidel, and Sebastian Thrun · 2008
Earlier work this paper cites.
Articulated mesh animation from multi-view silhouettes
Daniel Vlasic, Ilya Baran, Wojciech Matusik, and Jovan Popović · 2008
Earlier work this paper cites.
Human video textures
Matthew Flagg, Atsushi Nakazawa, Qiushuang Zhang, Sing Bing Kang, Young Kee Ryu, Irfan Essa, and James M Rehg · 2009
Earlier work this paper cites.
Computer vision: algorithms and applications
Richard Szeliski · 2010
Earlier work this paper cites.
Video-based characters: creating new human performances from a multi-view video database
Feng Xu, Yebin Liu, Carsten Stoll, James Tompkin, Gaurav Bharaj, Qionghai Dai, Hans-Peter Seidel, Jan Kautz, and Christian Theobalt · 2011
Earlier work this paper cites.
Depth synthesis and local warps for plausible image-based navigation
Gaurav Chaurasia, Sylvain Duchene, Olga Sorkine-Hornung, and George Drettakis · 2013
Earlier work this paper cites.
4D video textures for interactive character appearance
Dan Casas, Marco Volino, John Collomosse, and Adrian Hilton · 2014
Earlier work this paper cites.
High-quality streamable free-viewpoint video
Alvaro Collet, Ming Chuang, Pat Sweeney, Don Gillett, Dennis Evseev, David Calabrese, Hugues Hoppe, Adam Kirk, and Steve Sullivan · 2015
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba · 2015
Earlier work this paper cites.
SMPL: A skinned multi-person linear model
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black · 2015
Earlier work this paper cites.
Scalable inside-out image-based rendering
Peter Hedman, Tobias Ritschel, George Drettakis, and Gabriel Brostow · 2016
Earlier work this paper cites.
Pixelwise view selection for unstructured multi-view stereo
Johannes Lutz Schönberger, Enliang Zheng, Marc Pollefeys, and Jan-Michael Frahm · 2016
Earlier work this paper cites.
Pose guided person image generation
Liqian Ma, Xu Jia, Qianru Sun, Bernt Schiele, Tinne Tuytelaars, and Luc Van Gool · 2017
Earlier work this paper cites.
Video based reconstruction of 3d people models
Thiemo Alldieck, Marcus Magnor, Weipeng Xu, Christian Theobalt, and Gerard Pons-Moll · 2018
Earlier work this paper cites.
Synthesizing images of humans in unseen poses
Guha Balakrishnan, Amy Zhao, Adrian V Dalca, Fredo Durand, and John Guttag · 2018
Earlier work this paper cites.
Instant 3D photography
Peter Hedman and Johannes Kopf · 2018
Cited alongside, same era.
LookinGood: Enhancing performance capture with real-time neural re-rendering
Ricardo Martin-Brualla, Rohit Pandey, Shuoran Yang, Pavel Pidlypenskyi, Jonathan Taylor, Julien Valentin, Sameh Khamis, Philip Davidson, Anastasia Tkach, Peter Lincoln, et al · 2018
Cited alongside, same era.
Dense pose transfer
Natalia Neverova, Riza Alp Guler, and Iasonas Kokkinos · 2018
Cited alongside, same era.
Video-to-video synthesis
Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu, Guilin Liu, Andrew Tao, Jan Kautz, and Bryan Catanzaro · 2018
Cited alongside, same era.
The unreasonable effectiveness of deep features as a perceptual metric
Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang · 2018
Cited alongside, same era.
Everybody dance now
Caroline Chan, Shiry Ginosar, Tinghui Zhou, and Alexei A Efros · 2019
Cited alongside, same era.
SAPE: Spatially-adaptive progressive encoding for neural optimization
Amir Hertz, Or Perel, Raja Giryes, Olga Sorkine-Hornung, and Daniel Cohen-Or · 2021
Later among the works it cites.
Editable free-viewpoint video using a layered neural representation
Zhang Jiakai, Liu Xinhang, Ye Xinyi, Zhao Fuqiang, Zhang Yanshun, Wu Minye, Zhang Yingliang, Xu Lan, and Yu Jingyi · 2021
Later among the works it cites.
Neural scene flow fields for space-time view synthesis of dynamic scenes
Zhengqi Li, Simon Niklaus, Noah Snavely, and Oliver Wang · 2021
Later among the works it cites.
Neural actor: Neural free-view synthesis of human actors with pose control
Lingjie Liu, Marc Habermann, Viktor Rudnev, Kripasindhu Sarkar, Jiatao Gu, and Christian Theobalt · 2021
Later among the works it cites.
NeRF in the wild: Neural radiance fields for unconstrained photo collections
Ricardo Martin-Brualla, Noha Radwan, Mehdi S. M. Sajjadi, Jonathan T. Barron, Alexey Dosovitskiy, and Daniel Duckworth · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
The relightables: Volumetric performance capture of humans with realistic relighting
Kaiwen Guo, Peter Lincoln, Philip Davidson, Jay Busch, Xueming Yu, Matt Whalen, Geoff Harvey, Sergio Orts-Escolano, Rohit Pandey, Jason Dourgarian, et al · 2019
Cited alongside, same era.
Learning to reconstruct 3D human pose and shape via model-fitting in the loop
Nikos Kolotouros, Georgios Pavlakos, Michael J. Black, and Kostas Daniilidis · 2019
Cited alongside, same era.
Volumetric capture of humans with a single RGBD camera via semi-parametric learning
Rohit Pandey, Anastasia Tkach, Shuoran Yang, Pavel Pidlypenskyi, Jonathan Taylor, Ricardo Martin-Brualla, Andrea Tagliasacchi, George Papandreou, Philip Davidson, Cem Keskin, et al · 2019
Cited alongside, same era.
Loopreg: Self-supervised learning of implicit surface correspondences, pose and shape for 3d human mesh registration
Bharat Lal Bhatnagar, Cristian Sminchisescu, Christian Theobalt, and Gerard Pons-Moll · 2020
Cited alongside, same era.
Neural articulated shape approximation
Boyang Deng, JP Lewis, Timothy Jeruzalski, Gerard Pons-Moll, Geoffrey Hinton, Mohammad Norouzi, and Andrea Tagliasacchi · 2020
Cited alongside, same era.
Arch: Animatable reconstruction of clothed humans
Zeng Huang, Yuanlu Xu, Christoph Lassner, Hao Li, and Tony Tung · 2020
Cited alongside, same era.
LEAP: Learning articulated occupancy of people
Marko Mihajlovic, Yan Zhang, Michael J Black, and Siyu Tang · 2021
Later among the works it cites.
GIRAFFE: Representing scenes as compositional generative neural feature fields
Michael Niemeyer and Andreas Geiger · 2021
Later among the works it cites.
Neural articulated radiance field
Atsuhiro Noguchi, Xiao Sun, Stephen Lin, and Tatsuya Harada · 2021
Later among the works it cites.
Nerfies: Deformable neural radiance fields
Keunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz, Dan B Goldman, Steven M. Seitz, and Ricardo Martin-Brualla · 2021
Later among the works it cites.
HyperNeRF: A higher-dimensional representation for topologically varying neural radiance fields
Keunhong Park, Utkarsh Sinha, Peter Hedman, Jonathan T. Barron, Sofien Bouaziz, Dan B Goldman, Ricardo Martin-Brualla, and Steven M. Seitz · 2021
Later among the works it cites.
Animatable neural radiance fields for modeling dynamic human bodies
Sida Peng, Junting Dong, Qianqian Wang, Shangzhan Zhang, Qing Shuai, Xiaowei Zhou, and Hujun Bao · 2021
Later among the works it cites.
Neural body: Implicit neural representations with structured latent codes for novel view synthesis of dynamic humans
Sida Peng, Yuanqing Zhang, Yinghao Xu, Qianqian Wang, Qing Shuai, Hujun Bao, and Xiaowei Zhou · 2021
Later among the works it cites.
SCANimate: Weakly supervised learning of skinned clothed avatar networks
Shunsuke Saito, Jinlong Yang, Qianli Ma, and Michael J. Black · 2021
Later among the works it cites.
Learning realistic human reposing using cyclic self-supervision with 3D shape, pose, and appearance consistency
Soubhik Sanyal, Alex Vorobiov, Timo Bolkart, Matthew Loper, Betty Mohler, Larry S Davis, Javier Romero, and Michael J Black · 2021
Later among the works it cites.
Style and pose control for image synthesis of humans from a single monocular view
Kripasindhu Sarkar, Vladislav Golyanik, Lingjie Liu, and Christian Theobalt · 2021
Later among the works it cites.
NeRV: Neural reflectance and visibility fields for relighting and view synthesis
Pratul P. Srinivasan, Boyang Deng, Xiuming Zhang, Matthew Tancik, Ben Mildenhall, and Jonathan T. Barron · 2021
Later among the works it cites.
A-nerf: Articulated neural radiance fields for learning human shape, appearance, and pose
Shih-Yang Su, Frank Yu, Michael Zollhöfer, and Helge Rhodin · 2021
Later among the works it cites.
Neural-gif: Neural generalized implicit functions for animating people in clothing
Garvita Tiwari, Nikolaos Sarafianos, Tony Tung, and Gerard Pons-Moll · 2021
Later among the works it cites.
Non-rigid neural radiance fields: Reconstruction and novel view synthesis of a dynamic scene from monocular video
Edgar Tretschk, Ayush Tewari, Vladislav Golyanik, Michael Zollhöfer, Christoph Lassner, and Christian Theobalt · 2021
Later among the works it cites.
IBRNet: Learning multi-view image-based rendering
Qianqian Wang, Zhicheng Wang, Kyle Genova, Pratul Srinivasan, Howard Zhou, Jonathan T. Barron, Ricardo Martin-Brualla, Noah Snavely, and Thomas Funkhouser · 2021
Later among the works it cites.
Dance in the wild: Monocular human animation with neural dynamic appearance synthesis
Tuanfeng Y Wang, Duygu Ceylan, Krishna Kumar Singh, and Niloy J Mitra · 2021
Later among the works it cites.
Space-time neural irradiance fields for free-viewpoint video
Wenqi Xian, Jia-Bin Huang, Johannes Kopf, and Changil Kim · 2021
Later among the works it cites.
H-nerf: Neural radiance fields for rendering and temporal reconstruction of humans in motion
Hongyi Xu, Thiemo Alldieck, and Cristian Sminchisescu · 2021
Later among the works it cites.
S3: Neural shape, skeleton, and skinning fields for 3d human modeling
Ze Yang, Shenlong Wang, Siva Manivasagam, Zeng Huang, Wei-Chiu Ma, Xinchen Yan, Ersin Yumer, and Raquel Urtasun · 2021
Later among the works it cites.
NeRFactor: Neural factorization of shape and reflectance under an unknown illumination
Xiuming Zhang, Pratul P. Srinivasan, Boyang Deng, Paul Debevec, William T. Freeman, and Jonathan T. Barron · 2021
Later among the works it cites.
Instant neural graphics primitives with a multiresolution hash encoding
Thomas Müller, Alex Evans, Christoph Schied, and Alexander Keller · 2022
Closest in time.