Fetching the paper…
Reading the bibliography…
We introduce 4D Motion Scaffolds (MoSca), a modern 4D reconstruction system designed to reconstruct and synthesize novel views of dynamic scenes from monocular videos captured casually in the wild.
A volumetric method for building complex models from range images
Brian Curless and Marc Levoy · 1996
Earlier work this paper cites.
A morphable model for the synthesis of 3d faces
Volker Blanz and Thomas Vetter · 1999
Earlier work this paper cites.
Hand-eye calibration using dual quaternions
Konstantinos Daniilidis · 1999
Earlier work this paper cites.
High-quality video view interpolation using a layered representation
C. Lawrence Zitnick, Sing Bing Kang, Matthew Uyttendaele, Simon Winder, and Richard Szeliski · 2004
Earlier work this paper cites.
Skinning with dual quaternions
Ladislav Kavan, Steven Collins, Jiří Žára, and Carol O’Sullivan · 2007
Earlier work this paper cites.
Embedded deformation for shape manipulation
Robert W Sumner, Johannes Schmid, and Mark Pauly · 2007
Earlier work this paper cites.
Global correspondence optimization for non-rigid registration of depth scans
Hao Li, Robert W Sumner, and Mark Pauly · 2008
Earlier work this paper cites.
View and time interpolation in image space
Timo Stich, Christian Linz, Georgia Albuquerque, and Marcus Magnor · 2008
Earlier work this paper cites.
A naturalistic open source movie for optical flow evaluation
Daniel J Butler, Jonas Wulff, Garrett B Stanley, and Michael J Black · 2012
Earlier work this paper cites.
Reconstructing 3d human pose from 2d image landmarks
Varun Ramakrishna, Takeo Kanade, and Yaser Sheikh · 2012
Earlier work this paper cites.
A benchmark for the evaluation of rgb-d slam systems
Jürgen Sturm, Nikolas Engelhard, Felix Endres, Wolfram Burgard, and Daniel Cremers · 2012
Earlier work this paper cites.
Real-time non-rigid reconstruction using an rgb-d camera
Michael Zollhöfer, Matthias Nießner, Shahram Izadi, Christoph Rehmann, Christopher Zach, Matthew Fisher, Chenglei Wu, Andrew Fitzgibbon, Charles Loop, Christian Theobalt, et al · 2014
Earlier work this paper cites.
3d scanning deformable objects with a single rgbd sensor
Mingsong Dou, Jonathan Taylor, Henry Fuchs, Andrew Fitzgibbon, and Shahram Izadi · 2015
Earlier work this paper cites.
Dynamicfusion: Reconstruction and tracking of non-rigid scenes in real-time
Richard A Newcombe, Dieter Fox, and Steven M Seitz · 2015
Earlier work this paper cites.
Keep it smpl: Automatic estimation of 3d human pose and shape from a single image
Federica Bogo, Angjoo Kanazawa, Christoph Lassner, Peter Gehler, Javier Romero, and Michael J Black · 2016
Earlier work this paper cites.
The 2017 davis challenge on video object segmentation
Jordi Pont-Tuset, Federico Perazzi, Sergi Caelles, Pablo Arbeláez, Alex Sorkine-Hornung, and Luc Van Gool · 2017
Earlier work this paper cites.
Surfelwarp: Efficient non-volumetric single view dynamic reconstruction
Wei Gao and Russ Tedrake · 2018
Earlier work this paper cites.
Nonlinear 3d face morphable model
Luan Tran and Xiaoming Liu · 2018
Earlier work this paper cites.
4d visualization of dynamic events from unconstrained multi-view videos
Aayush Bansal, Minh Vo, Yaser Sheikh, Deva Ramanan, and Srinivasa Narasimhan · 2020
Earlier work this paper cites.
X-fields: Implicit neural view-, light- and time-image interpolation
Mojtaba Bemana, Karol Myszkowski, Hans-Peter Seidel, and Tobias Ritschel · 2020
Earlier work this paper cites.
Neural non-rigid tracking
Aljaz Bozic, Pablo Palafox, Michael Zollöfer, Angela Dai, Justus Thies, and Matthias Nießner · 2020
Earlier work this paper cites.
Raft: Recurrent all-pairs field transforms for optical flow
Zachary Teed and Jia Deng · 2020
Earlier work this paper cites.
Novel view synthesis of dynamic scenes with globally coherent depths from a monocular camera
Jae Shin Yoon, Kihwan Kim, Orazio Gallo, Hyun Soo Park, and Jan Kautz · 2020
Earlier work this paper cites.
Mip-nerf: A multiscale representation for anti-aliasing neural radiance fields
Jonathan T Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, and Pratul P Srinivasan · 2021
Earlier work this paper cites.
On the opportunities and risks of foundation models
Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al · 2021
Earlier work this paper cites.
Neural radiance flow for 4d view synthesis and video processing
Yilun Du, Yinan Zhang, Hong-Xing Yu, Joshua B Tenenbaum, and Jiajun Wu · 2021
Earlier work this paper cites.
Dynamic view synthesis from dynamic monocular video
Chen Gao, Ayush Saraf, Johannes Kopf, and Jia-Bin Huang · 2021
Earlier work this paper cites.
Robust consistent video depth estimation
Johannes Kopf, Xuejian Rong, and Jia-Bin Huang · 2021
Earlier work this paper cites.
Neural scene flow fields for space-time view synthesis of dynamic scenes
Zhengqi Li, Simon Niklaus, Noah Snavely, and Oliver Wang · 2021
Earlier work this paper cites.
Nerf: Representing scenes as neural radiance fields for view synthesis
Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng · 2021
Earlier work this paper cites.
D-nerf: Neural radiance fields for dynamic scenes
Albert Pumarola, Enric Corona, Gerard Pons-Moll, and Francesc Moreno-Noguer · 2021
Earlier work this paper cites.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021
Earlier work this paper cites.
Droid-slam: Deep visual slam for monocular, stereo, and rgb-d cameras
Zachary Teed and Jia Deng · 2021
Earlier work this paper cites.
Non-rigid neural radiance fields: Reconstruction and novel view synthesis of a dynamic scene from monocular video
Edgar Tretschk, Ayush Tewari, Vladislav Golyanik, Michael Zollhöfer, Christoph Lassner, and Christian Theobalt · 2021
Earlier work this paper cites.
Neural trajectory fields for dynamic novel view synthesis
Chaoyang Wang, Ben Eckart, Simon Lucey, and Orazio Gallo · 2021
Cited alongside, same era.
Space-time neural irradiance fields for free-viewpoint video
Wenqi Xian, Jia-Bin Huang, Johannes Kopf, and Changil Kim · 2021
Cited alongside, same era.
Lasr: Learning articulated shape reconstruction from a monocular video
Gengshan Yang, Deqing Sun, Varun Jampani, Daniel Vlasic, Forrester Cole, Huiwen Chang, Deva Ramanan, William T Freeman, and Ce Liu · 2021
Cited alongside, same era.
Rignerf: Fully controllable neural 3d portraits
ShahRukh Athar, Zexiang Xu, Kalyan Sunkavalli, Eli Shechtman, and Zhixin Shu · 2022
Cited alongside, same era.
Tensorf: Tensorial radiance fields
Anpei Chen, Zexiang Xu, Andreas Geiger, Jingyi Yu, and Hao Su · 2022
Cited alongside, same era.
Fast dynamic radiance fields with time-aware neural voxels
Dynmf: Neural motion factorization for real-time dynamic view synthesis with 3d gaussian splatting
Agelos Kratimenos, Jiahui Lei, and Kostas Daniilidis · 2023
Later among the works it cites.
Fast view synthesis of casual videos
Yao-Chih Lee, Zhoutong Zhang, Kevin Blackburn-Matzen, Simon Niklaus, Jianming Zhang, Jia-Bin Huang, and Feng Liu · 2023
Later among the works it cites.
Gart: Gaussian articulated template models
Jiahui Lei, Yufu Wang, Georgios Pavlakos, Lingjie Liu, and Kostas Daniilidis · 2023
Later among the works it cites.
Gaufre: Gaussian deformation fields for real-time dynamic novel view synthesis
Yiqing Liang, Numair Khan, Zhengqin Li, Thu Nguyen-Phuoc, Douglas Lanman, James Tompkin, and Lei Xiao · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Jiemin Fang, Taoran Yi, Xinggang Wang, Lingxi Xie, Xiaopeng Zhang, Wenyu Liu, Matthias Nießner, and Qi Tian · 2022
Cited alongside, same era.
Monocular dynamic view synthesis: A reality check
Hang Gao, Ruilong Li, Shubham Tulsiani, Bryan Russell, and Angjoo Kanazawa · 2022
Cited alongside, same era.
Particle video revisited: Tracking through occlusions using point trajectories
Adam W. Harley, Zhaoyuan Fang, and Katerina Fragkiadaki · 2022
Cited alongside, same era.
Approximate differentiable rendering with algebraic surfaces
Leonid Keselman and Martial Hebert · 2022
Cited alongside, same era.
Neural 3d video synthesis from multi-view video
Tianye Li, Mira Slavcheva, Michael Zollhoefer, Simon Green, Christoph Lassner, Changil Kim, Tanner Schmidt, Steven Lovegrove, Michael Goesele, Richard Newcombe, et al · 2022
Cited alongside, same era.
Instant neural graphics primitives with a multiresolution hash encoding
Thomas Müller, Alex Evans, Christoph Schied, and Alexander Keller · 2022
Cited alongside, same era.
Humannerf: Free-viewpoint rendering of moving people from monocular video
Chung-Yi Weng, Brian Curless, Pratul P Srinivasan, Jonathan T Barron, and Ira Kemelmacher-Shlizerman · 2022
Cited alongside, same era.
Jonathon Luiten, Georgios Kopanas, Bastian Leibe, and Deva Ramanan · 2023
Later among the works it cites.
Gpt-4 technical report, 2023
OpenAI · 2023
Later among the works it cites.
Dinov2: Learning robust visual features without supervision
Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al · 2023
Later among the works it cites.
3dgs-avatar: Animatable avatars via deformable 3d gaussian splatting
Zhiyin Qian, Shaofei Wang, Marko Mihajlovic, Andreas Geiger, and Siyu Tang · 2023
Later among the works it cites.
Nerfplayer: A streamable dynamic scene representation with decomposed neural radiance fields
Liangchen Song, Anpei Chen, Zhong Li, Zhang Chen, Lele Chen, Junsong Yuan, Yi Xu, and Andreas Geiger · 2023
Later among the works it cites.
Mononerf: Learning a generalizable dynamic radiance field from monocular videos
Fengrui Tian, Shaoyi Du, and Yueqi Duan · 2023
Later among the works it cites.
4d gaussian splatting for real-time dynamic scene rendering
Guanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie, Xiaopeng Zhang, Wei Wei, Wenyu Liu, Qi Tian, and Xinggang Wang · 2023
Later among the works it cites.
Decoupling dynamic monocular videos for dynamic view synthesis
Meng You and Junhui Hou · 2023
Later among the works it cites.
Leap-vo: Long-term effective any point tracking for visual odometry
Weirong Chen, Le Chen, Rui Wang, and Marc Pollefeys · 2024
Closest in time.
Dreamscene4d: Dynamic multi-object scene generation from monocular videos
Wen-Hsuan Chu, Lei Ke, and Katerina Fragkiadaki · 2024
Closest in time.
Bootstap: Bootstrapped training for tracking-any-point
Carl Doersch, Pauline Luc, Yi Yang, Dilara Gokay, Skanda Koppula, Ankush Gupta, Joseph Heyward, Ignacio Rocco, Ross Goroshin, Joao Carreira, and Andrew Zisserman · 2024
Closest in time.
4d gaussian splatting: Towards efficient novel view synthesis for dynamic scenes
Yuanxing Duan, Fangyin Wei, Qiyu Dai, Yuhang He, Wenzheng Chen, and Baoquan Chen · 2024
Closest in time.
D-npc: Dynamic neural point clouds for non-rigid view synthesis from monocular video
Moritz Kappel, Florian Hahlbohm, Timon Scholz, Susana Castillo, Christian Theobalt, Martin Eisemann, Vladislav Golyanik, and Marcus Magnor · 2024
Closest in time.
Cotracker3: Simpler and better point tracking by pseudo-labelling real videos
Nikita Karaev, Iurii Makarov, Jianyuan Wang, Natalia Neverova, Andrea Vedaldi, and Christian Rupprecht · 2024
Closest in time.
Ctnerf: Cross-time transformer for dynamic neural radiance field from monocular video
Xingyu Miao, Yang Bai, Haoran Duan, Yawen Huang, Fan Wan, Yang Long, and Yefeng Zheng · 2024
Closest in time.
Unidepth: Universal monocular metric depth estimation
Luigi Piccinelli, Yung-Hsu Yang, Christos Sakaridis, Mattia Segu, Siyuan Li, Luc Van Gool, and Fisher Yu · 2024
Closest in time.
Rig3dgs: Creating controllable portraits from casual monocular videos
Alfredo Rivero, ShahRukh Athar, Zhixin Shu, and Dimitris Samaras · 2024
Closest in time.
Dynomo: Online point tracking by dynamic online monocular gaussian reconstruction
Jenny Seidenschwarz, Qunjie Zhou, Bardienus Duisterhof, Deva Ramanan, and Laura Leal-Taixé · 2024
Closest in time.
Splattingavatar: Realistic real-time human avatars with mesh-embedded gaussian splatting
Zhijing Shao, Zhaolong Wang, Zhuang Li, Duotun Wang, Xiangru Lin, Yu Zhang, Mingming Fan, and Zeyu Wang · 2024
Closest in time.
Dynamic gaussian marbles for novel view synthesis of casual monocular videos
Colton Stearns, Adam W. Harley, Mikaela Uy, Florian Dubost, Federico Tombari, Gordon Wetzstein, and Leonidas Guibas · 2024
Closest in time.
Haha: Highly articulated gaussian human avatars with textured mesh prior
David Svitov, Pietro Morerio, Lourdes Agapito, and Alessio Del Bue · 2024
Closest in time.
Deep patch visual odometry
Zachary Teed, Lahav Lipson, and Jia Deng · 2024
Closest in time.
Gomavatar: Efficient animatable human modeling from monocular video using gaussians-on-mesh
Jing Wen, Xiaoming Zhao, Zhongzheng Ren, Alexander G Schwing, and Shenlong Wang · 2024
Closest in time.
Spatialtracker: Tracking any 2d pixels in 3d space
Yuxi Xiao, Qianqian Wang, Shangzhan Zhang, Nan Xue, Sida Peng, Yujun Shen, and Xiaowei Zhou · 2024
Closest in time.
Depth anything: Unleashing the power of large-scale unlabeled data
Lihe Yang, Bingyi Kang, Zilong Huang, Xiaogang Xu, Jiashi Feng, and Hengshuang Zhao · 2024
Closest in time.
Gaussian opacity fields: Efficient and compact surface reconstruction in unbounded scenes
Zehao Yu, Torsten Sattler, and Andreas Geiger · 2024
Closest in time.
Monst3r: A simple approach for estimating geometry in the presence of motion
Junyi Zhang, Charles Herrmann, Junhwa Hur, Varun Jampani, Trevor Darrell, Forrester Cole, Deqing Sun, and Ming-Hsuan Yang · 2024
Closest in time.
Pseudo-generalized dynamic view synthesis from a video, 2024
Xiaoming Zhao, Alex Colburn, Fangchang Ma, Miguel Angel Bautista, Joshua M. Susskind, and Alexander G. Schwing · 2024
Closest in time.
Dynpoint: Dynamic neural point for view synthesis
Kaichen Zhou, Jia-Xing Zhong, Sangyun Shin, Kai Lu, Yiyuan Yang, Andrew Markham, and Niki Trigoni · 2024
Closest in time.