Fetching the paper…
Reading the bibliography…
We present a method to perform novel view and time synthesis of dynamic scenes, requiring only a monocular video with known camera poses as input.
Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach
Paul E Debevec, Camillo J Taylor, and Jitendra Malik · 1996
Earlier work this paper cites.
The lumigraph
Steven J Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F Cohen · 1996
Earlier work this paper cites.
Light field rendering
Marc Levoy and Pat Hanrahan · 1996
Earlier work this paper cites.
Plenoptic sampling
Jin-Xiang Chai, Xin Tong, Shing-Chow Chan, and Heung-Yeung Shum · 2000
Earlier work this paper cites.
Unstructured lumigraph rendering
Chris Buehler, Michael Bosse, Leonard McMillan, Steven Gortler, and Michael Cohen · 2001
Earlier work this paper cites.
High-quality video view interpolation using a layered representation
C Lawrence Zitnick, Sing Bing Kang, Matthew Uyttendaele, Simon Winder, and Richard Szeliski · 2004
Earlier work this paper cites.
Photo tourism: Exploring photo collections in 3D
Noah Snavely, Steven M. Seitz, and Richard Szeliski · 2006
Earlier work this paper cites.
View and time interpolation in image space
Timo Stich, Christian Linz, Georgia Albuquerque, and Marcus Magnor · 2008
Earlier work this paper cites.
3d reconstruction of a moving point from a series of 2d projections
Hyun Soo Park, Takaaki Shiratori, Iain Matthews, and Yaser Sheikh · 2010
Earlier work this paper cites.
3D Reconstruction of a Moving Point from a Series of 2D Projections
Hyun Soo Park, Takaaki Shiratori, Iain A. Matthews, and Yaser Sheikh · 2010
Earlier work this paper cites.
Unstructured light fields
Abe Davis, Marc Levoy, and Frédo Durand · 2012
Earlier work this paper cites.
General trajectory prior for non-rigid reconstruction
Jack Valmadre and S. Lucey · 2012
Earlier work this paper cites.
Depth synthesis and local warps for plausible image-based navigation
Gaurav Chaurasia, Sylvain Duchene, Olga Sorkine-Hornung, and George Drettakis · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P. Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Video pop-up: Monocular 3d reconstruction of dynamic scenes
Chris Russell, Rui Yu, and Lourdes Agapito · 2014
Earlier work this paper cites.
Light field reconstruction using sparsity in the continuous fourier domain
Lixin Shi, Haitham Hassanieh, Abe Davis, Dina Katabi, and Frédo Durand · 2014
Earlier work this paper cites.
Real-time simultaneous pose and shape estimation for articulated objects using a single depth camera
Mao Ye and Ruigang Yang · 2014
Earlier work this paper cites.
Real-time non-rigid reconstruction using an RGB-D camera
Michael Zollhöfer, Matthias Niessner, Shahram Izadi, Christoph Rehmann, Christopher Zach, Matthew Fisher, Chenglei Wu, Andrew Fitzgibbon, Charles Loop, Christian Theobalt, et al · 2014
Earlier work this paper cites.
Sampling based scene-space video processing
Felix Klose, Oliver Wang, Jean-Charles Bazin, Marcus Magnor, and Alexander Sorkine-Hornung · 2015
Earlier work this paper cites.
DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time
Richard A Newcombe, Dieter Fox, and Steven M Seitz · 2015
Earlier work this paper cites.
Layered rgbd scene flow estimation
Deqing Sun, Erik B Sudderth, and Hanspeter Pfister · 2015
Earlier work this paper cites.
Light field reconstruction using shearlet transform
Suren Vagharshakyan, Robert Bregovic, and Atanas P. Gotchev · 2015
Earlier work this paper cites.
Sparse Dynamic 3D Reconstruction from Unsynchronized Videos
Enliang Zheng, Dinghuang Ji, Enrique Dunn, and Jan-Michael Frahm · 2015
Earlier work this paper cites.
Fusion4D: real-time performance capture of challenging scenes
Mingsong Dou, Sameh Khamis, Yury Degtyarev, Philip L. Davidson, Sean Ryan Fanello, Adarsh Kowdle, Sergio Orts, Christoph Rhemann, David Kim, Jonathan Taylor, Pushmeet Kohli, Vladimir Tankovich, and Shahram Izadi · 2016
Earlier work this paper cites.
Deepstereo: Learning to predict new views from the world’s imagery
John Flynn, Ivan Neulander, James Philbin, and Noah Snavely · 2016
Earlier work this paper cites.
VolumeDeform: Real-time volumetric non-rigid reconstruction
Matthias Innmann, Michael Zollhöfer, Matthias Niessner, Christian Theobalt, and Marc Stamminger · 2016
Earlier work this paper cites.
Dense monocular depth estimation in complex dynamic scenes
Rene Ranftl, Vibhav Vineet, Qifeng Chen, and Vladlen Koltun · 2016
Earlier work this paper cites.
Structure-from-motion revisited
Johannes L Schonberger and Jan-Michael Frahm · 2016
Earlier work this paper cites.
Spatiotemporal bundle adjustment for dynamic 3d reconstruction
Minh Vo, S. Narasimhan, and Yaser Sheikh · 2016
Earlier work this paper cites.
Mask r-cnn
Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick · 2017
Cited alongside, same era.
Casual 3d photography
Peter Hedman, Suhib Alsisan, Richard Szeliski, and Johannes Kopf · 2017
Cited alongside, same era.
Flownet 2.0: Evolution of optical flow estimation with deep networks
Eddy Ilg, Nikolaus Mayer, Tonmoy Saikia, Margret Keuper, Alexey Dosovitskiy, and Thomas Brox · 2017
Cited alongside, same era.
Monocular dense 3d reconstruction of a complex dynamic scene from two perspective frames
Suryansh Kumar, Yuchao Dai, and Hongdong Li · 2017
Cited alongside, same era.
Unflow: Unsupervised learning of optical flow with a bidirectional census loss
Simon Meister, Junhwa Hur, and Stefan Roth · 2017
Cited alongside, same era.
Video frame interpolation via adaptive convolution
Simon Niklaus, Long Mai, and Feng Liu · 2017
Scene representation networks: Continuous 3d-structure-aware neural scene representations
Vincent Sitzmann, Michael Zollhöfer, and Gordon Wetzstein · 2019
Later among the works it cites.
Pushing the boundaries of view extrapolation with multiplane images
Pratul P Srinivasan, Richard Tucker, Jonathan T Barron, Ravi Ramamoorthi, Ren Ng, and Noah Snavely · 2019
Later among the works it cites.
Deferred neural rendering: Image synthesis using neural textures
Justus Thies, Michael Zollhöfer, and Matthias Nießner · 2019
Later among the works it cites.
Deep view synthesis from sparse photometric images
Zexiang Xu, Sai Bi, Kalyan Sunkavalli, Sunil Hadap, Hao Su, and Ravi Ramamoorthi · 2019
Later among the works it cites.
4d visualization of dynamic events from unconstrained multi-view videos
Aayush Bansal, Minh Vo, Yaser Sheikh, Deva Ramanan, and Srinivasa Narasimhan · 2020
Closest in time.
X-fields: Implicit neural view-, light-and time-image interpolation
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Video frame interpolation via adaptive separable convolution
Simon Niklaus, Long Mai, and Feng Liu · 2017
Cited alongside, same era.
Soft 3d reconstruction for view synthesis
Eric Penner and Li Zhang · 2017
Cited alongside, same era.
Kronecker-Markov Prior for Dynamic 3D Reconstruction
Tomas Simon, Jack Valmadre, Iain A. Matthews, and Yaser Sheikh · 2017
Cited alongside, same era.
Neural scene representation and rendering
SM Ali Eslami, Danilo Jimenez Rezende, Frederic Besse, Fabio Viola, Ari S Morcos, Marta Garnelo, Avraham Ruderman, Andrei A Rusu, Ivo Danihelka, Karol Gregor, et al · 2018
Cited alongside, same era.
Deep blending for free-viewpoint image-based rendering
Peter Hedman, Julien Philip, True Price, Jan-Michael Frahm, George Drettakis, and Gabriel Brostow · 2018
Cited alongside, same era.
Super slomo: High quality estimation of multiple intermediate frames for video interpolation
Huaizu Jiang, Deqing Sun, Varun Jampani, Ming-Hsuan Yang, Erik G. Learned-Miller, and Jan Kautz · 2018
Cited alongside, same era.
Mojtaba Bemana, Karol Myszkowski, Hans-Peter Seidel, and Tobias Ritschel · 2020
Closest in time.
Neural reflectance fields for appearance acquisition
S. Bi, Zexiang Xu, Pratul P. Srinivasan, Ben Mildenhall, Kalyan Sunkavalli, Milovs Havsan, Yannick Hold-Geoffroy, D. Kriegman, and R. Ramamoorthi · 2020
Closest in time.
Deep reflectance volumes: Relightable reconstructions from multi-view photometric images
Sai Bi, Zexiang Xu, Kalyan Sunkavalli, Miloš Hašan, Yannick Hold-Geoffroy, David Kriegman, and Ravi Ramamoorthi · 2020
Closest in time.
Deep 3d capture: Geometry and reflectance from sparse multi-view images
Sai Bi, Zexiang Xu, Kalyan Sunkavalli, David Kriegman, and Ravi Ramamoorthi · 2020
Closest in time.
Deepdeform: Learning non-rigid rgb-d reconstruction with semi-supervised data
Aljaz Bozic, Michael Zollhofer, Christian Theobalt, and Matthias Niessner · 2020
Closest in time.
Immersive light field video with a layered mesh representation
Michael Broxton, John Flynn, Ryan Overbeck, Daniel Erickson, Peter Hedman, Matthew Duvall, Jason Dourgarian, Jay Busch, Matt Whalen, and Paul Debevec · 2020
Closest in time.
Self-supervised monocular scene flow estimation
Junhwa Hur and Stefan Roth · 2020
Closest in time.
Nrmvs: Non-rigid multi-view stereo
M. Innmann, Kihwan Kim, Jinwei Gu, M. Nießner, Charles T. Loop, M. Stamminger, and J. Kautz · 2020
Closest in time.
Crowdsampling the plenoptic function
Zhengqi Li, Wenqi Xian, Abe Davis, and Noah Snavely · 2020
Closest in time.
Layered neural rendering for retiming people in video
Erika Lu, F. Cole, Tali Dekel, Weidi Xie, Andrew Zisserman, D. Salesin, W. Freeman, and M. Rubinstein · 2020
Closest in time.
Consistent video depth estimation
Xuan Luo, Jia-Bin Huang, Richard Szeliski, Kevin Matzen, and Johannes Kopf · 2020
Closest in time.
Nerf in the wild: Neural radiance fields for unconstrained photo collections
Ricardo Martin-Brualla, N. Radwan, Mehdi S. M. Sajjadi, J. Barron, A. Dosovitskiy, and Daniel Duckworth · 2020
Closest in time.
Nerf: Representing scenes as neural radiance fields for view synthesis
Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng · 2020
Closest in time.
Just go with the flow: Self-supervised scene flow estimation
Himangi Mittal, Brian Okorn, and David Held · 2020
Closest in time.
Softmax splatting for video frame interpolation
Simon Niklaus and Feng Liu · 2020
Closest in time.
Revisiting adaptive convolutions for video frame interpolation
Simon Niklaus, Long Mai, and Oliver Wang · 2020
Closest in time.
Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer
René Ranftl, Katrin Lasinger, David Hafner, Konrad Schindler, and Vladlen Koltun · 2020
Closest in time.
Free view synthesis
Gernot Riegler and V. Koltun · 2020
Closest in time.
3d photography using context-aware layered depth inpainting
Meng-Li Shih, Shih-Yang Su, Johannes Kopf, and Jia-Bin Huang · 2020
Closest in time.
Raft: Recurrent all-pairs field transforms for optical flow
Zachary Teed and Jia Deng · 2020
Closest in time.
Single-view view synthesis with multiplane images
Richard Tucker and Noah Snavely · 2020
Closest in time.
Synsin: End-to-end view synthesis from a single image
Olivia Wiles, Georgia Gkioxari, R. Szeliski, and J. Johnson · 2020
Closest in time.
Novel view synthesis of dynamic scenes with globally coherent depths from a monocular camera
Jae Shin Yoon, Kihwan Kim, Orazio Gallo, Hyun Soo Park, and Jan Kautz · 2020
Closest in time.