Fetching the paper…
Reading the bibliography…
We propose the Large View Synthesis Model (LVSM), a novel transformer-based approach for scalable and generalizable novel view synthesis from sparse-view inputs.
Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach
Paul E. Debevec, Camillo Jose Taylor, and Jitendra Malik · 1996
Earlier work this paper cites.
The lumigraph
Steven J. Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F. Cohen · 1996
Earlier work this paper cites.
Light field rendering
Marc Levoy and Pat Hanrahan · 1996
Earlier work this paper cites.
Plenoptic modeling and rendering from image sequences taken by a hand-held camera
Benno Heigl, Reinhard Koch, Marc Pollefeys, Joachim Denzler, and Luc Van Gool · 1999
Earlier work this paper cites.
Nerf: Representing scenes as neural radiance fields for view synthesis, 2020
Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik, Jonathan T. Barron, Ravi Ramamoorthi, and Ren Ng · 2003
Earlier work this paper cites.
Piecewise planar stereo for image-based rendering
Sudipta Sinha, Drew Steedly, and Rick Szeliski · 2009
Earlier work this paper cites.
Multi-view reconstruction preserving weakly-supported surfaces
Michal Jancosek and Tomas Pajdla · 2011
Earlier work this paper cites.
Unstructured light fields
Abe Davis, Marc Levoy, and Fredo Durand · 2012
Earlier work this paper cites.
pixelnerf: Neural radiance fields from one or few images, 2021
Alex Yu, Vickie Ye, Matthew Tancik, and Angjoo Kanazawa · 2012
Earlier work this paper cites.
Depth synthesis and local warps for plausible image-based navigation
Gaurav Chaurasia, Sylvain Duchene, Olga Sorkine-Hornung, and George Drettakis · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma · 2014
Earlier work this paper cites.
Training deep nets with sublinear memory cost
Tianqi Chen, Bing Xu, Chiyuan Zhang, and Carlos Guestrin · 2016
Earlier work this paper cites.
Perceptual losses for real-time style transfer and super-resolution
Justin Johnson, Alexandre Alahi, and Li Fei-Fei · 2016
Earlier work this paper cites.
View synthesis by appearance flow
Tinghui Zhou, Shubham Tulsiani, Weilun Sun, Jitendra Malik, and Alexei A Efros · 2016
Earlier work this paper cites.
Soft 3d reconstruction for view synthesis
Eric Penner and Li Zhang · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Deep blending for free-viewpoint image-based rendering
Peter Hedman, Julien Philip, True Price, Jan-Michael Frahm, George Drettakis, and Gabriel Brostow · 2018
Earlier work this paper cites.
Stereo magnification: Learning view synthesis using multiplane images
Tinghui Zhou, Richard Tucker, John Flynn, Graham Fyffe, and Noah Snavely · 2018
Earlier work this paper cites.
Extreme view synthesis
Inchang Choi, Orazio Gallo, Alejandro Troccoli, Min H Kim, and Jan Kautz · 2019
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding, 2019
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2019
Earlier work this paper cites.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al · 2019
Earlier work this paper cites.
Scene representation networks: Continuous 3d-structure-aware neural scene representations
Vincent Sitzmann, Michael Zollhöfer, and Gordon Wetzstein · 2019
Earlier work this paper cites.
An image is worth 16x16 words: Transformers for image recognition at scale
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby · 2020
Earlier work this paper cites.
Query-key normalization for transformers
Alex Henry, Prudhvi Raj Dachapally, Shubham Pawar, and Yuxuan Chen · 2020
Earlier work this paper cites.
Neural sparse voxel fields
Lingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua, and Christian Theobalt · 2020
Earlier work this paper cites.
Mip-nerf: A multiscale representation for anti-aliasing neural radiance fields
Jonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, and Pratul P. Srinivasan · 2021
Earlier work this paper cites.
Mvsnerf: Fast generalizable radiance field reconstruction from multi-view stereo, 2021
Anpei Chen, Zexiang Xu, Fuqiang Zhao, Xiaoshuai Zhang, Fanbo Xiang, Jingyi Yu, and Hao Su · 2021
Earlier work this paper cites.
Baking neural radiance fields for real-time view synthesis
Peter Hedman, Pratul P Srinivasan, Ben Mildenhall, Jonathan T Barron, and Paul Debevec · 2021
Earlier work this paper cites.
Perceiver io: A general architecture for structured inputs & outputs
Andrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac, Carl Doersch, Catalin Ionescu, David Ding, Skanda Koppula, Daniel Zoran, Andrew Brock, Evan Shelhamer, et al · 2021
Cited alongside, same era.
Nerf in the wild: Neural radiance fields for unconstrained photo collections
Ricardo Martin-Brualla, Noha Radwan, Mehdi SM Sajjadi, Jonathan T Barron, Alexey Dosovitskiy, and Daniel Duckworth · 2021
Cited alongside, same era.
Kilonerf: Speeding up neural radiance fields with thousands of tiny mlps
Christian Reiser, Songyou Peng, Yiyi Liao, and Andreas Geiger · 2021
Cited alongside, same era.
Geometry-free view synthesis: Transformers and no 3d priors
Robin Rombach, Patrick Esser, and Björn Ommer · 2021
Cited alongside, same era.
Light field networks: Neural scene representations with single-evaluation rendering
Vincent Sitzmann, Semon Rezchikov, Bill Freeman, Josh Tenenbaum, and Fredo Durand · 2021
Cited alongside, same era.
Objaverse: A universe of annotated 3d objects
Matt Deitke, Dustin Schwenk, Jordi Salvador, Luca Weihs, Oscar Michel, Eli VanderBilt, Ludwig Schmidt, Kiana Ehsani, Aniruddha Kembhavi, and Ali Farhadi · 2023
Later among the works it cites.
Learning to render novel views from wide-baseline stereo pairs, 2023
Yilun Du, Cameron Smith, Ayush Tewari, and Vincent Sitzmann · 2023
Later among the works it cites.
Leap: Liberate sparse-view 3d modeling from camera poses
Hanwen Jiang, Zhenyu Jiang, Yue Zhao, and Qixing Huang · 2023
Later among the works it cites.
3d gaussian splatting for real-time radiance field rendering
Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, and George Drettakis · 2023
Later among the works it cites.
Instant3d: Fast text-to-3d with sparse-view generation and large reconstruction model, 2023
Jiahao Li, Hao Tan, Kai Zhang, Zexiang Xu, Fujun Luan, Yinghao Xu, Yicong Hong, Kalyan Sunkavalli, Greg Shakhnarovich, and Sai Bi · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Efficient geometry-aware 3d generative adversarial networks
Eric R Chan, Connor Z Lin, Matthew A Chan, Koki Nagano, Boxiao Pan, Shalini De Mello, Orazio Gallo, Leonidas J Guibas, Jonathan Tremblay, Sameh Khamis, et al · 2022
Cited alongside, same era.
Tensorf: Tensorial radiance fields
Anpei Chen, Zexiang Xu, Andreas Geiger, Jingyi Yu, and Hao Su · 2022
Cited alongside, same era.
Google scanned objects: A high-quality dataset of 3d scanned household items, 2022
Laura Downs, Anthony Francis, Nate Koenig, Brandon Kinman, Ryan Hickman, Krista Reymann, Thomas B. McHugh, and Vincent Vanhoucke · 2022
Cited alongside, same era.
Neural points: Point cloud representation with neural fields for arbitrary upsampling
Wanquan Feng, Jin Li, Hongrui Cai, Xiaonan Luo, and Juyong Zhang · 2022
Cited alongside, same era.
Plenoxels: Radiance fields without neural networks
Sara Fridovich-Keil, Alex Yu, Matthew Tancik, Qinhong Chen, Benjamin Recht, and Angjoo Kanazawa · 2022
Cited alongside, same era.
Geonerf: Generalizing nerf with geometry priors, 2022
Mohammad Mahdi Johari, Yann Lepoittevin, and François Fleuret · 2022
Cited alongside, same era.
Viewformer: Nerf-free neural rendering from few images using transformers
Jonáš Kulhánek, Erik Derner, Torsten Sattler, and Robert Babuška · 2022
Cited alongside, same era.
Later among the works it cites.
Wonder3d: Single image to 3d using cross-domain diffusion
Xiaoxiao Long, Yuan-Chen Guo, Cheng Lin, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, et al · 2023
Later among the works it cites.
Merf: Memory-efficient radiance fields for real-time view synthesis in unbounded scenes
Christian Reiser, Rick Szeliski, Dor Verbin, Pratul Srinivasan, Ben Mildenhall, Andreas Geiger, Jon Barron, and Peter Hedman · 2023
Later among the works it cites.
Dmv3d: Denoising multi-view diffusion using 3d large reconstruction model, 2023
Yinghao Xu, Hao Tan, Fujun Luan, Sai Bi, Peng Wang, Jiahao Li, Zifan Shi, Kalyan Sunkavalli, Gordon Wetzstein, Zexiang Xu, and Kai Zhang · 2023
Later among the works it cites.
Consistnet: Enforcing 3d consistency for multi-view images diffusion
Jiayu Yang, Ziang Cheng, Yunfei Duan, Pan Ji, and Hongdong Li · 2023
Later among the works it cites.
Consistent-1-to-3: Consistent image to 3d view synthesis via geometry-aware diffusion models
Jianglong Ye, Peng Wang, Kejie Li, Yichun Shi, and Heng Wang · 2023
Later among the works it cites.
Genie: Generative interactive environments
Jake Bruce, Michael D Dennis, Ashley Edwards, Jack Parker-Holder, Yuge Shi, Edward Hughes, Matthew Lai, Aditi Mavalankar, Richie Steigerwald, Chris Apps, et al · 2024
Closest in time.
pixelsplat: 3d gaussian splats from image pairs for scalable generalizable 3d reconstruction
David Charatan, Sizhe Lester Li, Andrea Tagliasacchi, and Vincent Sitzmann · 2024
Closest in time.
Mvsplat: Efficient 3d gaussian splatting from sparse multi-view images, 2024
Yuedong Chen, Haofei Xu, Chuanxia Zheng, Bohan Zhuang, Marc Pollefeys, Andreas Geiger, Tat-Jen Cham, and Jianfei Cai · 2024
Closest in time.
Scaling rectified flow transformers for high-resolution image synthesis
Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas Müller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, et al · 2024
Closest in time.
Cat3d: Create anything in 3d with multi-view diffusion models
Ruiqi Gao*, Aleksander Holynski*, Philipp Henzler, Arthur Brussee, Ricardo Martin-Brualla, Pratul P. Srinivasan, Jonathan T. Barron, and Ben Poole* · 2024
Closest in time.
Cameractrl: Enabling camera control for text-to-video generation, 2024
Hao He, Yinghao Xu, Yuwei Guo, Gordon Wetzstein, Bo Dai, Hongsheng Li, and Ceyuan Yang · 2024
Closest in time.
Lrm: Large reconstruction model for single image to 3d, 2024
Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, and Hao Tan · 2024
Closest in time.
Few-view object reconstruction with unknown categories and camera poses
Hanwen Jiang, Zhenyu Jiang, Kristen Grauman, and Yuke Zhu · 2024
Closest in time.
Eschernet: A generative model for scalable view synthesis
Xin Kong, Shikun Liu, Xiaoyang Lyu, Marwan Taher, Xiaojuan Qi, and Andrew J Davison · 2024
Closest in time.
Lgm: Large multi-view gaussian model for high-resolution 3d content creation
Jiaxiang Tang, Zhaoxi Chen, Xiaokang Chen, Tengfei Wang, Gang Zeng, and Ziwei Liu · 2024
Closest in time.
Megascenes: Scene-level view synthesis at scale
Joseph Tung, Gene Chou, Ruojin Cai, Guandao Yang, Kai Zhang, Gordon Wetzstein, Bharath Hariharan, and Noah Snavely · 2024
Closest in time.
Meshlrm: Large reconstruction model for high-quality mesh
Xinyue Wei, Kai Zhang, Sai Bi, Hao Tan, Fujun Luan, Valentin Deschaintre, Kalyan Sunkavalli, Hao Su, and Zexiang Xu · 2024
Closest in time.
Lrm-zero: Training large reconstruction models with synthesized data
Desai Xie, Sai Bi, Zhixin Shu, Kai Zhang, Zexiang Xu, Yi Zhou, Sören Pirk, Arie Kaufman, Xin Sun, and Hao Tan · 2024
Closest in time.
Streetcrafter: Street view synthesis with controllable video diffusion models, 2024
Yunzhi Yan, Zhen Xu, Haotong Lin, Haian Jin, Haoyu Guo, Yida Wang, Kun Zhan, Xianpeng Lang, Hujun Bao, Xiaowei Zhou, and Sida Peng · 2024
Closest in time.
Gs-lrm: Large reconstruction model for 3d gaussian splatting, 2024
Kai Zhang, Sai Bi, Hao Tan, Yuanbo Xiangli, Nanxuan Zhao, Kalyan Sunkavalli, and Zexiang Xu · 2024
Closest in time.
Free3d: Consistent novel view synthesis without 3d representation
Chuanxia Zheng and Andrea Vedaldi · 2024
Closest in time.
Sv3d: Novel multi-view synthesis and 3d generation from a single image using latent video diffusion
Vikram Voleti, Chun-Han Yao, Mark Boss, Adam Letts, David Pankratz, Dmitry Tochilkin, Christian Laforte, Robin Rombach, and Varun Jampani · 2025
Closest in time.