Fetching the paper…
Reading the bibliography…
Modeling animatable human avatars from RGB videos is a long-standing and challenging problem.
C. G. Broyden, “A class of methods for solving nonlinear simultaneous equations,” Mathematics of computation , vol. 19, no. 92, pp. 577–593, 1965
1965
Earlier work this paper cites.
J. T. Kajiya, “The rendering equation,” in Proceedings of the 13th annual conference on Computer graphics and interactive techniques , 1986, pp. 143–150
1986
Earlier work this paper cites.
W. E. Lorensen and H. E. Cline, “Marching cubes: A high resolution 3d surface construction algorithm,” TOG , vol. 21, no. 4, pp. 163–169, 1987
1987
Earlier work this paper cites.
H. Pfister, M. Zwicker, J. Van Baar, and M. Gross, “Surfels: Surface elements as rendering primitives,” in SIGGRAPH , 2000, pp. 335–342
2000
Earlier work this paper cites.
P. Debevec, T. Hawkins, C. Tchou, H.-P. Duiker, W. Sarokin, and M. Sagar, “Acquiring the reflectance field of a human face,” in Proceedings of the 27th annual conference on Computer graphics and interactive techniques , 2000, pp. 145–156
2000
Earlier work this paper cites.
M. Zwicker, H. Pfister, J. Van Baar, and M. Gross, “Surface splatting,” in SIGGRAPH , 2001, pp. 371–378
2001
Earlier work this paper cites.
T. Hawkins, J. Cohen, and P. Debevec, “A photometric approach to digitizing cultural artifacts,” in Proceedings of the 2001 conference on Virtual reality, archeology, and cultural heritage , 2001, pp. 333–342
2001
Earlier work this paper cites.
M. Zwicker, M. Pauly, O. Knoll, and M. Gross, “Pointshop 3d: An interactive system for point-based surface editing,” TOG , vol. 21, no. 3, pp. 322–329, 2002
2002
Earlier work this paper cites.
P. Debevec, A. Wenger, C. Tchou, A. Gardner, J. Waese, and T. Hawkins, “A lighting reproduction approach to live-action compositing,” TOG , vol. 21, no. 3, pp. 547–556, 2002
2002
Earlier work this paper cites.
M. Zwicker, J. Rasanen, M. Botsch, C. Dachsbacher, and M. Pauly, “Perspective accurate splatting,” in Proceedings-Graphics Interface , 2004, pp. 247–254
2004
Earlier work this paper cites.
Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE T-IP , vol. 13, no. 4, pp. 600–612, 2004
2004
Earlier work this paper cites.
A. Wenger, A. Gardner, C. Tchou, J. Unger, T. Hawkins, and P. Debevec, “Performance relighting and reflectance transformation with time-multiplexed illumination,” TOG , vol. 24, no. 3, pp. 756–764, 2005
2005
Earlier work this paper cites.
C.-F. Chabert, P. Einarsson, A. Jones, B. Lamond, W.-C. Ma, S. Sylwan, T. Hawkins, and P. Debevec, “Relighting human locomotion with flowed reflectance fields,” in ACM SIGGRAPH 2006 Sketches , 2006, pp. 76–es
2006
Earlier work this paper cites.
T. Weyrich, W. Matusik, H. Pfister, B. Bickel, C. Donner, C. Tu, J. McAndless, J. Lee, A. Ngan, H. W. Jensen et al. , “Analysis of human faces using a measurement-based skin reflectance model,” TOG , vol. 25, no. 3, pp. 1013–1024, 2006
2006
Earlier work this paper cites.
R. W. Sumner, J. Schmid, and M. Pauly, “Embedded deformation for shape manipulation,” TOG , vol. 26, no. 3, pp. 80–es, 2007
2007
Earlier work this paper cites.
C. Stoll, J. Gall, E. De Aguiar, S. Thrun, and C. Theobalt, “Video-based reconstruction of animatable human characters,” TOG , vol. 29, no. 6, pp. 1–10, 2010
2010
Earlier work this paper cites.
F. Xu, Y. Liu, C. Stoll, J. Tompkin, G. Bharaj, Q. Dai, H.-P. Seidel, J. Kautz, and C. Theobalt, “Video-based characters: creating new human performances from a multi-view video database,” TOG , vol. 30, no. 4, pp. 1–10, 2011
2011
Earlier work this paper cites.
P. Guan, L. Reiss, D. A. Hirshberg, A. Weiss, and M. J. Black, “Drape: Dressing any person,” TOG , vol. 31, no. 4, pp. 1–10, 2012
2012
Earlier work this paper cites.
P. Debevec, “The light stages and their applications to photoreal digital actors,” SIGGRAPH Asia , vol. 2, no. 4, pp. 1–6, 2012
2012
Earlier work this paper cites.
M. Loper, N. Mahmood, J. Romero, G. Pons-Moll, and M. J. Black, “Smpl: A skinned multi-person linear model,” TOG , vol. 34, no. 6, pp. 1–16, 2015
2015
Earlier work this paper cites.
D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” in ICLR , 2015
2015
Earlier work this paper cites.
O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in MICCAI . Springer, 2015, pp. 234–241
2015
Earlier work this paper cites.
C. R. Qi, H. Su, K. Mo, and L. J. Guibas, “Pointnet: Deep learning on point sets for 3d classification and segmentation,” in CVPR , 2017, pp. 652–660
2017
Earlier work this paper cites.
C. R. Qi, L. Yi, H. Su, and L. J. Guibas, “Pointnet++: Deep hierarchical feature learning on point sets in a metric space,” in NeurIPS , 2017
2017
Earlier work this paper cites.
M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter, “Gans trained by a two time-scale update rule converge to a local nash equilibrium,” NeurIPS , vol. 30, 2017
2017
Earlier work this paper cites.
T. Alldieck, M. Magnor, W. Xu, C. Theobalt, and G. Pons-Moll, “Video based reconstruction of 3d people models,” in CVPR , 2018, pp. 8387–8397
2018
Earlier work this paper cites.
——, “Detailed human avatars from monocular video,” in 3DV . IEEE, 2018, pp. 98–109
2018
Earlier work this paper cites.
R. A. Güler, N. Neverova, and I. Kokkinos, “Densepose: Dense human pose estimation in the wild,” in CVPR , 2018, pp. 7297–7306
2018
Earlier work this paper cites.
R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang, “The unreasonable effectiveness of deep features as a perceptual metric,” in CVPR , 2018, pp. 586–595
2018
Earlier work this paper cites.
T. Karras, S. Laine, and T. Aila, “A style-based generator architecture for generative adversarial networks,” in CVPR , 2019, pp. 4401–4410
2019
Earlier work this paper cites.
W. Yifan, F. Serena, S. Wu, C. Öztireli, and O. Sorkine-Hornung, “Differentiable surface splatting for point-based geometry processing,” TOG , vol. 38, no. 6, pp. 1–14, 2019
2019
Earlier work this paper cites.
K. Guo, P. Lincoln, P. Davidson, J. Busch, X. Yu, M. Whalen, G. Harvey, S. Orts-Escolano, R. Pandey, J. Dourgarian et al. , “The relightables: Volumetric performance capture of humans with realistic relighting,” TOG , vol. 38, no. 6, pp. 1–19, 2019
2019
Earlier work this paper cites.
G. Pavlakos, V. Choutas, N. Ghorbani, T. Bolkart, A. A. A. Osman, D. Tzionas, and M. J. Black, “Expressive body capture: 3d hands, face, and body from a single image,” in CVPR , 2019
2019
Earlier work this paper cites.
N. Mahmood, N. Ghorbani, N. F. Troje, G. Pons-Moll, and M. J. Black, “Amass: Archive of motion capture as surface shapes,” in ICCV , 2019, pp. 5442–5451
2019
Earlier work this paper cites.
B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng, “Nerf: Representing scenes as neural radiance fields for view synthesis,” in ECCV . Springer, 2020, pp. 405–421
2020
Earlier work this paper cites.
M. Tancik, P. Srinivasan, B. Mildenhall, S. Fridovich-Keil, N. Raghavan, U. Singhal, R. Ramamoorthi, J. Barron, and R. Ng, “Fourier features let networks learn high frequency functions in low dimensional domains,” NeurIPS , vol. 33, pp. 7537–7547, 2020
2020
Earlier work this paper cites.
T. Karras, S. Laine, M. Aittala, J. Hellsten, J. Lehtinen, and T. Aila, “Analyzing and improving the image quality of stylegan,” in CVPR , 2020, pp. 8110–8119
2020
Earlier work this paper cites.
B. Deng, J. P. Lewis, T. Jeruzalski, G. Pons-Moll, G. Hinton, M. Norouzi, and A. Tagliasacchi, “Nasa neural articulated shape approximation,” in ECCV . Springer, 2020, pp. 612–628
2020
Earlier work this paper cites.
K.-A. Aliev, A. Sevastopolsky, M. Kolos, D. Ulyanov, and V. Lempitsky, “Neural point-based graphics,” in ECCV . Springer, 2020, pp. 696–712
2020
Earlier work this paper cites.
2020
Earlier work this paper cites.
S. Saito, T. Simon, J. Saragih, and H. Joo, “Pifuhd: Multi-level pixel-aligned implicit function for high-resolution 3d human digitization,” in CVPR , June 2020
2020
Earlier work this paper cites.
A. Gropp, L. Yariv, N. Haim, M. Atzmon, and Y. Lipman, “Implicit geometric regularization for learning shapes,” in ICML . PMLR, 2020, pp. 3789–3799
2020
Earlier work this paper cites.
T. Bagautdinov, C. Wu, T. Simon, F. Prada, T. Shiratori, S.-E. Wei, W. Xu, Y. Sheikh, and J. Saragih, “Driving-signal aware full-body avatars,” TOG , vol. 40, no. 4, pp. 1–17, 2021
2021
Cited alongside, same era.
Q. Ma, J. Yang, S. Tang, and M. J. Black, “The power of points for modeling humans in clothing,” in ICCV , 2021, pp. 10 974–10 984
2021
Cited alongside, same era.
S. Peng, J. Dong, Q. Wang, S. Zhang, Q. Shuai, X. Zhou, and H. Bao, “Animatable neural radiance fields for modeling dynamic human bodies,” in ICCV , 2021, pp. 14 314–14 323
2021
Cited alongside, same era.
L. Liu, M. Habermann, V. Rudnev, K. Sarkar, J. Gu, and C. Theobalt, “Neural actor: Neural free-view synthesis of human actors with pose control,” TOG , vol. 40, no. 6, pp. 1–16, 2021
2021
Cited alongside, same era.
T. Karras, M. Aittala, S. Laine, E. Härkönen, J. Hellsten, J. Lehtinen, and T. Aila, “Alias-free generative adversarial networks,” NeurIPS , vol. 34, pp. 852–863, 2021
Q. Xu, Z. Xu, J. Philip, S. Bi, Z. Shu, K. Sunkavalli, and U. Neumann, “Point-nerf: Point-based neural radiance fields,” in CVPR , 2022, pp. 5438–5448
2022
Later among the works it cites.
D. Rückert, L. Franke, and M. Stamminger, “Adop: Approximate differentiable one-pixel point rendering,” TOG , vol. 41, no. 4, pp. 1–14, 2022
2022
Later among the works it cites.
Z. Chen and Z. Liu, “Relighting4d: Neural relightable human from videos,” in ECCV . Springer, 2022, pp. 606–623
2022
Later among the works it cites.
B. Kerbl, G. Kopanas, T. Leimkühler, and G. Drettakis, “3d gaussian splatting for real-time radiance field rendering,” TOG , vol. 42, no. 4, pp. 1–14, 2023
2023
Closest in time.
L. Wang, X. Zhao, J. Sun, Y. Zhang, H. Zhang, T. Yu, and Y. Liu, “Styleavatar: Real-time photo-realistic portrait avatar from a single video,” in SIGGRAPH Conference Proceedings , 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2021
Cited alongside, same era.
D. Xiang, F. Prada, T. Bagautdinov, W. Xu, Y. Dong, H. Wen, J. Hodgins, and C. Wu, “Modeling clothing as a separate layer for an animatable human avatar,” TOG , vol. 40, no. 6, pp. 1–15, 2021
2021
Cited alongside, same era.
M. Habermann, L. Liu, W. Xu, M. Zollhoefer, G. Pons-Moll, and C. Theobalt, “Real-time deep dynamic characters,” TOG , vol. 40, no. 4, pp. 1–16, 2021
2021
Cited alongside, same era.
A. Burov, M. Nießner, and J. Thies, “Dynamic surface function networks for clothed human bodies,” in ICCV , 2021, pp. 10 754–10 764
2021
Cited alongside, same era.
M. Mihajlovic, Y. Zhang, M. J. Black, and S. Tang, “Leap: Learning articulated occupancy of people,” in CVPR , 2021, pp. 10 461–10 471
2021
Cited alongside, same era.
S. Saito, J. Yang, Q. Ma, and M. J. Black, “Scanimate: Weakly supervised learning of skinned clothed avatar networks,” in CVPR , 2021, pp. 2886–2897
2021
Cited alongside, same era.
S. Wang, M. Mihajlovic, Q. Ma, A. Geiger, and S. Tang, “Metaavatar: Learning animatable clothed human models from few depth images,” NeurIPS , vol. 34, 2021
2021
Cited alongside, same era.
G. Tiwari, N. Sarafianos, T. Tung, and G. Pons-Moll, “Neural-gif: Neural generalized implicit functions for animating people in clothing,” in ICCV , 2021, pp. 11 708–11 718
2021
Cited alongside, same era.
2023
Closest in time.
H. Jin, I. Liu, P. Xu, X. Zhang, S. Han, S. Bi, X. Zhou, Z. Xu, and H. Su, “Tensoir: Tensorial inverse rendering,” in CVPR , 2023, pp. 165–174
2023
Closest in time.
2023
Closest in time.
M. Habermann, L. Liu, W. Xu, G. Pons-Moll, M. Zollhoefer, and C. Theobalt, “Hdhumans: A hybrid approach for high-fidelity digital humans,” ACM SCA , vol. 6, no. 3, pp. 1–23, 2023
2023
Closest in time.
Y. Kwon, L. Liu, H. Fuchs, M. Habermann, and C. Theobalt, “Deliffas: Deformable light fields for fast avatar synthesis,” in NeurIPS , 2023
2023
Closest in time.
2023
Closest in time.
H.-I. Ho, L. Xue, J. Song, and O. Hilliges, “Learning locally editable virtual humans,” in CVPR , 2023, pp. 21 024–21 035
2023
Closest in time.
X. Chen, T. Jiang, J. Song, M. Rietmann, A. Geiger, M. J. Black, and O. Hilliges, “Fast-snarf: A fast deformer for articulated neural fields,” IEEE T-PAMI , 2023
2023
Closest in time.
C. Guo, T. Jiang, X. Chen, J. Song, and O. Hilliges, “Vid2avatar: 3d avatar reconstruction from videos in the wild via self-supervised scene decomposition,” in CVPR , 2023, pp. 12 858–12 868
2023
Closest in time.
T. Jiang, X. Chen, J. Song, and O. Hilliges, “Instantavatar: Learning avatars from monocular video in 60 seconds,” in CVPR , 2023, pp. 16 922–16 932
2023
Closest in time.
Y. Chen, X. Wang, X. Chen, Q. Zhang, X. Li, Y. Guo, J. Wang, and F. Wang, “Uv volumes for real-time rendering of editable free-view human performance,” in CVPR , 2023, pp. 16 621–16 631
2023
Closest in time.
Z. Li, Z. Zheng, Y. Liu, B. Zhou, and Y. Liu, “Posevocab: Learning joint-structured pose embeddings for human avatar modeling,” in ACM SIGGRAPH Conference Proceedings , 2023
2023
Closest in time.
K. Shen, C. Guo, M. Kaufmann, J. J. Zarate, J. Valentin, J. Song, and O. Hilliges, “X-avatar: Expressive human avatars,” in CVPR , 2023, pp. 16 911–16 921
2023
Closest in time.
Z. Zheng, X. Zhao, H. Zhang, B. Liu, and Y. Liu, “Avatarrex: Real-time expressive full-body avatars,” TOG , vol. 42, no. 4, 2023
2023
Closest in time.
H. Zhang, S. Lin, R. Shao, Y. Zhang, Z. Zheng, H. Huang, Y. Guo, and Y. Liu, “Closet: Modeling clothed humans on continuous surface with explicit template decomposition,” in CVPR , 2023
2023
Closest in time.
S. Prokudin, Q. Ma, M. Raafat, J. Valentin, and S. Tang, “Dynamic point fields,” in ICCV , 2023, pp. 7964–7976
2023
Closest in time.
S.-Y. Su, T. Bagautdinov, and H. Rhodin, “Npc: Neural point characters from video,” in ICCV , 2023
2023
Closest in time.
Y. Zheng, W. Yifan, G. Wetzstein, M. J. Black, and O. Hilliges, “Pointavatar: Deformable point-based head avatars from videos,” in CVPR , 2023, pp. 21 057–21 067
2023
Closest in time.
2023
Closest in time.
2023
Closest in time.
2023
Closest in time.
2023
Closest in time.
2023
Closest in time.
U. Iqbal, A. Caliskan, K. Nagano, S. Khamis, P. Molchanov, and J. Kautz, “Rana: Relightable articulated neural avatars,” in ICCV , 2023, pp. 23 142–23 153
2023
Closest in time.
W. Sun, Y. Che, H. Huang, and Y. Guo, “Neural reconstruction of relightable human model from monocular video,” in ICCV , 2023, pp. 397–407
2023
Closest in time.
2023
Closest in time.
M. Işık, M. Rünz, M. Georgopoulos, T. Khakhulin, J. Starck, L. Agapito, and M. Nießner, “Humanrf: High-fidelity neural radiance fields for humans in motion,” TOG , vol. 42, no. 4, pp. 1–12, 2023
2023
Closest in time.
2023
Closest in time.
Z. Li, Z. Zheng, L. Wang, and Y. Liu, “Animatable gaussians: Learning pose-dependent gaussian maps for high-fidelity human avatar modeling,” in CVPR , 2024
2024
Closest in time.
J. Lei, Y. Wang, G. Pavlakos, L. Liu, and K. Daniilidis, “Gart: Gaussian articulated template models,” in CVPR , 2024
2024
Closest in time.
Z. Qian, S. Wang, M. Mihajlovic, A. Geiger, and S. Tang, “3dgs-avatar: Animatable avatars via deformable 3d gaussian splatting,” in CVPR , 2024
2024
Closest in time.
S. Hu and Z. Liu, “Gauhuman: Articulated gaussian splatting from monocular human videos,” in CVPR , 2024
2024
Closest in time.
M. Kocabas, J.-H. R. Chang, J. Gabriel, O. Tuzel, and A. Ranjan, “Hugs: Human gaussian splats,” in CVPR , 2024
2024
Closest in time.
H. Pang, H. Zhu, A. Kortylewski, C. Theobalt, and M. Habermann, “Ash: Animatable gaussian splats for efficient and photoreal human rendering,” in CVPR , 2024
2024
Closest in time.
L. Hu, H. Zhang, Y. Zhang, B. Zhou, B. Liu, S. Zhang, and L. Nie, “Gaussianavatar: Towards realistic human avatar modeling from a single video via animatable 3d gaussians,” in CVPR , 2024
2024
Closest in time.
W. Lin, C. Zheng, J.-H. Yong, and F. Xu, “Relightable and animatable neural avatars from videos,” in AAAI , vol. 38, no. 4, 2024, pp. 3486–3494
2024
Closest in time.
X. Deng, Z. Zheng, Y. Zhang, J. Sun, C. Xu, x. Yang, L. Wang, and Y. Liu, “Ram-avatar: Real-time photo-realistic avatar from monocular videos with full-body control,” in CVPR , 2024
2024
Closest in time.