Fetching the paper…
Reading the bibliography…
We suggest to represent an X-Field -a set of 2D images taken across different view, time or illumination conditions, i.e., video, light field, reflectance fields or combinations thereof-by learning a neural network (NN) to map their view, time or light coordinates to 2D images.
The Lumigraph. In SIGGRAPH
Steven J Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F Cohen. 1996 · 1996
Earlier work this paper cites.
Light field rendering. In SIGGRAPH
Marc Levoy and Pat Hanrahan. 1996 · 1996
Earlier work this paper cites.
Post-rendering 3D Warping. In Proc. i3D
William R Mark, Leonard McMillan, and Gary Bishop. 1997 · 1997
Earlier work this paper cites.
Interpolating View and Scene Motion by Dynamic View Morphing. In CVPR , Vol. 1. 388–394
Russell A. Manning and Charles R. Dyer. 1999 · 1999
Earlier work this paper cites.
Acquiring the Reflectance Field of a Human Face. In Proc. SIGGRAPH . 145–156
Paul Debevec, Tim Hawkins, Chris Tchou, Haarm-Pieter Duiker, Westley Sarokin, and Mark Sagar. 2000 · 2000
Earlier work this paper cites.
Unstructured Lumigraph Rendering. In Proc. SIGGRAPH
Chris Buehler, Michael Bosse, Leonard McMillan, Steven Gortler, and Michael Cohen. 2001 · 2001
Earlier work this paper cites.
Polynomial Texture Maps. In Proc. SIGGRAPH
Tom Malzbender, Dan Gelb, and Hans Wolters. 2001 · 2001
Earlier work this paper cites.
Computer Vision: a Modern Approach
David A Forsyth and Jean Ponce. 2002 · 2002
Earlier work this paper cites.
High-quality Video View Interpolation Using a Layered Representation. In ACM Trans. Graph. , Vol. 23
C Lawrence Zitnick, Sing Bing Kang, Matthew Uyttendaele, Simon Winder, and Richard Szeliski. 2004 · 2004
Earlier work this paper cites.
Light Source Interpolation for Sparsely Sampled Reflectance Fields. In Proc. Vision, Modeling and Visualization . 461–469
Billy Chen and Hendrik PA Lensch. 2005 · 2005
Earlier work this paper cites.
Towards Space: Time Light Field Rendering. In Proc. i3D
Huamin Wang and Ruigang Yang. 2005 · 2005
Earlier work this paper cites.
High performance imaging using large camera arrays
Bennett Wilburn, Neel Joshi, Vaibhav Vaish, Eino-Ville Talvala, Emilio Antunez, Adam Barth, Andrew Adams, Mark Horowitz, and Marc Levoy. 2005 · 2005
Earlier work this paper cites.
Reducing the Dimensionality of Data with Neural Networks
Geoffrey E Hinton and Ruslan R Salakhutdinov. 2006 · 2006
Earlier work this paper cites.
Adaptive Sampling of Reflectance Fields
Martin Fuchs, Volker Blanz, Hendrik P.A. Lensch, and Hans-Peter Seidel. 2007 · 2007
Earlier work this paper cites.
Moving Gradients: a Path-based Method for Plausible Image Interpolation. In ACM Trans. Graph. , Vol. 28. 42
Dhruv Mahajan, Fu-Chung Huang, Wojciech Matusik, Ravi Ramamoorthi, and Peter Belhumeur. 2009 · 2009
Earlier work this paper cites.
Compressive Light Transport Sensing
Pieter Peers, Dhruv K. Mahajan, Bruce Lamond, Abhijeet Ghosh, Wojciech Matusik, Ravi Ramamoorthi, and Paul Debevec. 2009 · 2009
Earlier work this paper cites.
Virtual Video Camera: Image-Based Viewpoint Navigation Through Space and Time
Christian Lipski, Christian Linz, Kai Berger, Anita Sellent, and Marcus Magnor. 2010 · 2010
Earlier work this paper cites.
A naturalistic open source movie for optical flow evaluation. In European Conf. on Computer Vision (ECCV) (Part IV, LNCS 7577) , A. Fitzgibbon et al. (Eds.) (Ed.). Springer-Verlag, 611–625
D. J. Butler, J. Wulff, G. B. Stanley, and M. J. Black. 2012 · 2012
Earlier work this paper cites.
Frequency-Space Decomposition and Acquisition of Light Transport under Spatially Varying Illumination. In Proc. ECCV . 596–610
Dikpal Reddy, Ravi Ramamoorthi, and Brian Curless. 2012 · 2012
Earlier work this paper cites.
Layered Segmentation and Optical Flow Estimation Over Time. In CVPR . 1768–1775
D. Sun, E. B. Sudderth, and M. J. Black. 2012 · 2012
Earlier work this paper cites.
Depth Synthesis and Local Warps for Plausible Image-based Navigation
Gaurav Chaurasia, Sylvain Duchene, Olga Sorkine-Hornung, and George Drettakis. 2013 · 2013
Earlier work this paper cites.
Auto-encoding Variational Bayes. In Proc. ICLR
Diederik P Kingma and Max Welling. 2013 · 2013
Earlier work this paper cites.
Image-Based Rendering in the Gradient Domain
Johannes Kopf, Fabian Langguth, Daniel Scharstein, Richard Szeliski, and Michael Goesele. 2013 · 2013
Earlier work this paper cites.
Improving Visual Quality of View Transitions in Automultiscopic Displays
Song-Pei Du, Piotr Didyk, Frédo Durand, Shi-Min Hu, and Wojciech Matusik. 2014 · 2014
Earlier work this paper cites.
Generative Adversarial Nets. In Proc. NIPS
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014 · 2014
Earlier work this paper cites.
Learning to Generate Chairs with Convolutional Neural Networks. In CVPR
Alexey Dosovitskiy, Jost Tobias Springenberg, and Thomas Brox. 2015 · 2015
Cited alongside, same era.
Spatial Transformer Networks. In Proc. NIPS
Max Jaderberg, Karen Simonyan, Andrew Zisserman, et al · 2015
Cited alongside, same era.
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
Alec Radford, Luke Metz, and Soumith Chintala. 2015 · 2015
Cited alongside, same era.
Deep Visual Analogy-making. In NIPS
Scott E Reed, Yi Zhang, Yuting Zhang, and Honglak Lee. 2015 · 2015
Cited alongside, same era.
Image Based Relighting Using Neural Networks
Peiran Ren, Yue Dong, Stephen Lin, Xin Tong, and Baining Guo. 2015 · 2015
Cited alongside, same era.
Efficient Multi-image Correspondences for On-line Light Field Video Processing
Łukasz Dabała, Matthias Ziegler, Piotr Didyk, Frederik Zilly, Joachim Keinert, Karol Myszkowski, Hans-Peter Seidel, Przemysław Rokita, and Tobias Ritschel. 2016 · 2016
The unreasonable effectiveness of deep features as a perceptual metric. In CVPR . 586–95
Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang. 2018 · 2018
Later among the works it cites.
Stereo Magnification: Learning View Synthesis Using Multiplane Images
Tinghui Zhou, Richard Tucker, John Flynn, Graham Fyffe, and Noah Snavely. 2018 · 2018
Later among the works it cites.
Df-net: Unsupervised Joint Learning of Depth and Flow Using Cross-task Consistency. In ECCV . 36–53
Yuliang Zou, Zelun Luo, and Jia-Bin Huang. 2018 · 2018
Later among the works it cites.
MEMC-Net: Motion Estimation and Motion Compensation Driven Neural Network for Video Interpolation and Enhancement
Wenbo Bao, Wei-Sheng Lai, Xiaoyun Zhang, Zhiyong Gao, and Ming-Hsuan Yang. 2019b · 2019
Later among the works it cites.
Monocular Neural Image Based Rendering with Continuous View Control. In ICCV
Xu Chen, Jie Song, and Otmar Hilliges. 2019 · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
DeepStereo: Learning to Predict New Views From the World’s Imagery. In CVPR
John Flynn, Ivan Neulander, James Philbin, and Noah Snavely. 2016 · 2016
Cited alongside, same era.
Scalable Inside-Out Image-Based Rendering
Peter Hedman, Tobias Ritschel, George Drettakis, and Gabriel Brostow. 2016 · 2016
Cited alongside, same era.
Learning-based View Synthesis for Light Field Cameras
Nima Khademi Kalantari, Ting-Chun Wang, and Ravi Ramamoorthi. 2016 · 2016
Cited alongside, same era.
Sampling Generative Networks
Tom White. 2016 · 2016
Cited alongside, same era.
View Synthesis by Appearance Flow. In ECCV
Tinghui Zhou, Shubham Tulsiani, Weilun Sun, Jitendra Malik, and Alexei A Efros. 2016 · 2016
Cited alongside, same era.
Neural Audio Synthesis of Musical Notes with Wavenet Autoencoders. In JMLR
Jesse Engel, Cinjon Resnick, Adam Roberts, Sander Dieleman, Mohammad Norouzi, Douglas Eck, and Karen Simonyan. 2017 · 2017
Cited alongside, same era.
Learning Implicit Fields for Generative Shape Modeling
Zhiqin Chen and Hao Zhang. 2019 · 2019
Later among the works it cites.
DeepView: View Synthesis With Learned Gradient Descent. In CVPR
John Flynn, Michael Broxton, Paul Debevec, Matthew DuVall, Graham Fyffe, Ryan Overbeck, Noah Snavely, and Richard Tucker. 2019 · 2019
Later among the works it cites.
Puppet Dubbing. In Proc. EGSR
Ohad Fried and Maneesh Agrawala. 2019 · 2019
Later among the works it cites.
The Relightables: Volumetric Performance Capture of Humans with Realistic Relighting
Kaiwen Guo et al · 2019
Later among the works it cites.
Escaping Plato’s Cave: 3D Shape From Adversarial Rendering
Philipp Henzler, Niloy J Mitra, , and Tobias Ritschel. 2019 · 2019
Later among the works it cites.
A Style-based Generator Architecture for Generative Adversarial Networks. In CVPR . 4401–4410
Tero Karras, Samuli Laine, and Timo Aila. 2019 · 2019
Later among the works it cites.
Neural Volumes: Learning Dynamic Renderable Volumes from Images
Stephen Lombardi, Tomas Simon, Jason Saragih, Gabriel Schwartz, Andreas Lehrmann, and Yaser Sheikh. 2019 · 2019
Later among the works it cites.
Deep Appearance Maps. In Proc. ICCV
Maxim Maximov, Laura Leal-Taixé, Mario Fritz, and Tobias Ritschel. 2019 · 2019
Later among the works it cites.
Deep Reflectance Fields - High-Quality Facial Reflectance Field Inference From Color Gradient Illumination
Abhimitra Meka et al · 2019
Later among the works it cites.
Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines
Ben Mildenhall, Pratul P. Srinivasan, Rodrigo Ortiz-Cayon, Nima Khademi Kalantari, Ravi Ramamoorthi, Ren Ng, and Abhishek Kar. 2019 · 2019
Later among the works it cites.
HoloGAN: Unsupervised Learning of 3D Representations From Natural Images. In ICCV
Thu Nguyen Phuoc, Chuan Li, Lucas Theis, Christian Richardt, and Yongliang Yang. 2019 · 2019
Later among the works it cites.
Occupancy Flow: 4D Reconstruction by Learning Particle Dynamics. In Proc. ICCV
Michael Niemeyer, Lars Mescheder, Michael Oechsle, and Andreas Geiger. 2019 · 2019
Later among the works it cites.
Texture Fields: Learning Texture Representations in Function Space
Michael Oechsle, Lars Mescheder, Michael Niemeyer, Thilo Strauss, and Andreas Geiger. 2019 · 2019
Later among the works it cites.
Multi-View Relighting Using a Geometry-Aware Network
Julien Philip, Michaël Gharbi, Tinghui Zhou, Alexei A. Efros, and George Drettakis. 2019 · 2019
Later among the works it cites.
PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization
Shunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima, Angjoo Kanazawa, and Hao Li. 2019 · 2019
Later among the works it cites.
Deferred Neural Rendering: Image Synthesis using Neural Textures
Justus Thies, Michael Zollhöfer, and Matthias Nießner. 2019 · 2019
Later among the works it cites.
Deep View Synthesis from Sparse Photometric Images
Zexiang Xu, Sai Bi, Kalyan Sunkavalli, Sunil Hadap, Hao Su, and Ravi Ramamoorthi. 2019 · 2019
Later among the works it cites.
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. 2020 · 2020
Closest in time.
State of the Art on Neural Rendering
A. Tewari, O. Fried, J. Thies, V. Sitzmann, S. Lombardi, K. Sunkavalli, R. Martin-Brualla, T. Simon, J. Saragih, M. Nießner, R. Pandey, S. Fanello, G. Wetzstein, J.-Y. Zhu, C. Theobalt, M. Agrawala, E. Shechtman, D. B Goldman, and M. Zollhöfer. 2020 · 2020
Closest in time.