Fetching the paper…
Reading the bibliography…
We introduce a co-designed approach for human portrait relighting that combines a physics-guided architecture with a pre-training framework.
Photometric method for determining surface orientation from multiple images
Robert J Woodham · 1980
Earlier work this paper cites.
A reflectance model for computer graphics
Robert L Cook and Kenneth E. Torrance · 1982
Earlier work this paper cites.
Interactive design of complex time dependent lighting
Julie Dorsey, James Arvo, and Donald Greenberg · 1995
Earlier work this paper cites.
Illumination for computer generated pictures
Bui Tuong Phong · 1998
Earlier work this paper cites.
Acquiring the reflectance field of a human face
Paul Debevec, Tim Hawkins, Chris Tchou, Haarm-Pieter Duiker, Westley Sarokin, and Mark Sagar · 2000
Earlier work this paper cites.
Performance relighting and reflectance transformation with time-multiplexed illumination
Andreas Wenger, Andrew Gardner, Chris Tchou, Jonas Unger, Tim Hawkins, and Paul Debevec · 2005
Earlier work this paper cites.
Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography
Paul Debevec · 2008
Earlier work this paper cites.
Shape, illumination, and reflectance from shading
Jonathan T Barron and Jitendra Malik · 2014
Earlier work this paper cites.
Style transfer for headshot portraits
YiChang Shih, Sylvain Paris, Connelly Barnes, William T Freeman, and Frédo Durand · 2014
Earlier work this paper cites.
Unsupervised visual representation learning by context prediction
Carl Doersch, Abhinav Gupta, and Alexei A Efros · 2015
Earlier work this paper cites.
Perceptual losses for real-time style transfer and super-resolution
Justin Johnson, Alexandre Alahi, and Li Fei-Fei · 2016
Earlier work this paper cites.
Unsupervised learning of visual representations by solving jigsaw puzzles
Mehdi Noroozi and Paolo Favaro · 2016
Earlier work this paper cites.
Context encoders: Feature learning by inpainting
Deepak Pathak, Philipp Krahenbuhl, Jeff Donahue, Trevor Darrell, and Alexei A Efros · 2016
Earlier work this paper cites.
Colorful image colorization
Richard Zhang, Phillip Isola, and Alexei A Efros · 2016
Earlier work this paper cites.
Image-to-image translation with conditional adversarial networks
Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros · 2017
Earlier work this paper cites.
Portrait lighting transfer using a mass transport approach
Zhixin Shu, Sunil Hadap, Eli Shechtman, Kalyan Sunkavalli, Sylvain Paris, and Dimitris Samaras · 2017
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018
Earlier work this paper cites.
Unsupervised representation learning by predicting image rotations
Spyros Gidaris, Praveer Singh, and Nikos Komodakis · 2018
Earlier work this paper cites.
Image inpainting for irregular holes using partial convolutions
Guilin Liu, Fitsum A Reda, Kevin J Shih, Ting-Chun Wang, Andrew Tao, and Bryan Catanzaro · 2018
Earlier work this paper cites.
Improving language understanding by generative pre-training
Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al · 2018
Cited alongside, same era.
Sfsnet: Learning shape, reflectance and illuminance of facesin the wild’
Soumyadip Sengupta, Angjoo Kanazawa, Carlos D Castillo, and David W Jacobs · 2018
Cited alongside, same era.
A style-based generator architecture for generative adversarial networks
Tero Karras, Samuli Laine, and Timo Aila · 2019
Cited alongside, same era.
Single image portrait relighting
Tiancheng Sun, Jonathan T Barron, Yun-Ta Tsai, Zexiang Xu, Xueming Yu, Graham Fyffe, Christoph Rhemann, Jay Busch, Paul Debevec, and Ravi Ramamoorthi · 2019
Cited alongside, same era.
Boundless: Generative adversarial networks for image extension
Piotr Teterwak, Aaron Sarna, Dilip Krishnan, Aaron Maschinot, David Belanger, Ce Liu, and William T Freeman · 2019
Cited alongside, same era.
Deep single-image portrait relighting
Real-time high-resolution background matting
Shanchuan Lin, Andrey Ryabtsev, Soumyadip Sengupta, Brian L Curless, Steven M Seitz, and Ira Kemelmacher-Shlizerman · 2021
Later among the works it cites.
Total relighting: learning to relight portraits for background replacement
Rohit Pandey, Sergio Orts Escolano, Chloe Legendre, Christian Haene, Sofien Bouaziz, Christoph Rhemann, Paul Debevec, and Sean Fanello · 2021
Later among the works it cites.
A light stage on every desk
Soumyadip Sengupta, Brian Curless, Ira Kemelmacher-Shlizerman, and Steven M Seitz · 2021
Later among the works it cites.
Relighting4d: Neural relightable human from videos
Zhaoxi Chen and Ziwei Liu · 2022
Later among the works it cites.
Masked autoencoders are scalable vision learners
Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, and Ross Girshick · 2022
Later among the works it cites.
Face relighting with geometrically consistent shadows
Andrew Hou, Michel Sarkis, Ning Bi, Yiying Tong, and Xiaoming Liu · 2022
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Hao Zhou, Sunil Hadap, Kalyan Sunkavalli, and David W Jacobs · 2019
Cited alongside, same era.
A simple framework for contrastive learning of visual representations
Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton · 2020
Cited alongside, same era.
An image is worth 16x16 words: Transformers for image recognition at scale
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al · 2020
Cited alongside, same era.
Momentum contrast for unsupervised visual representation learning
Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, and Ross Girshick · 2020
Cited alongside, same era.
Learning physics-guided face relighting under directional light
Thomas Nestmeyer, Jean-François Lalonde, Iain Matthews, and Andreas Lehrmann · 2020
Cited alongside, same era.
Background matting: The world is your green screen
Soumyadip Sengupta, Vivek Jayaram, Brian Curless, Steven M Seitz, and Ira Kemelmacher-Shlizerman · 2020
Cited alongside, same era.
Single image portrait relighting via explicit multiple reflectance channel modeling
Zhibo Wang, Xin Yu, Ming Lu, Quan Wang, Chen Qian, and Feng Xu · 2020
Cited alongside, same era.
Later among the works it cites.
Geometry-aware single-image full-body human relighting
Chaonan Ji, Tao Yu, Kaiwen Guo, Jingxin Liu, and Yebin Liu · 2022
Later among the works it cites.
Revisiting image pyramid structure for high resolution salient object detection
Taehun Kim, Kunhee Kim, Joonyeong Lee, Dongmin Cha, Jiho Lee, and Daijin Kim · 2022
Later among the works it cites.
Learning to relight portrait images via a virtual light stage and synthetic-to-real adaptation
Yu-Ying Yeh, Koki Nagano, Sameh Khamis, Jan Kautz, Ming-Yu Liu, and Ting-Chun Wang · 2022
Later among the works it cites.
Activating more pixels in image super-resolution transformer
Xiangyu Chen, Xintao Wang, Jiantao Zhou, Yu Qiao, and Chao Dong · 2023
Later among the works it cites.
Controllable light diffusion for portraits
David Futschik, Kelvin Ritland, James Vecore, Sean Fanello, Sergio Orts-Escolano, Brian Curless, Daniel Sỳkora, and Rohit Pandey · 2023
Later among the works it cites.
Degae: A new pretraining paradigm for low-level vision
Yihao Liu, Jingwen He, Jinjin Gu, Xiangtao Kong, Yu Qiao, and Chao Dong · 2023
Later among the works it cites.
Lightpainter: Interactive portrait relighting with freehand scribble
Yiqun Mei, He Zhang, Xuaner Zhang, Jianming Zhang, Zhixin Shu, Yilin Wang, Zijun Wei, Shi Yan, HyunJoon Jung, and Vishal M Patel · 2023
Later among the works it cites.
What do self-supervised vision transformers learn?
Namuk Park, Wonjae Kim, Byeongho Heo, Taekyung Kim, and Sangdoo Yun · 2023
Later among the works it cites.
Difareli: Diffusion face relighting
Puntawat Ponglertnapakorn, Nontawat Tritrong, and Supasorn Suwajanakorn · 2023
Later among the works it cites.
Sunstage: Portrait reconstruction and relighting using the sun as a light stage
Yifan Wang, Aleksander Holynski, Xiuming Zhang, and Xuaner Zhang · 2023
Later among the works it cites.
Convnext v2: Co-designing and scaling convnets with masked autoencoders
Sanghyun Woo, Shoubhik Debnath, Ronghang Hu, Xinlei Chen, Zhuang Liu, In So Kweon, and Saining Xie · 2023
Later among the works it cites.
Relightable neural human assets from multi-view gradient illuminations
Taotao Zhou, Kai He, Di Wu, Teng Xu, Qixuan Zhang, Kuixiang Shao, Wenzheng Chen, Lan Xu, and Jingyi Yu · 2023
Later among the works it cites.