Fetching the paper…
Reading the bibliography…
We present NeSF, a method for producing 3D semantic fields from posed RGB images alone.
Optical models for direct volume rendering
Nelson Max · 1995
Earlier work this paper cites.
Visual navigation for mobile robots: A survey
Francisco Bonin-Font, Alberto Ortiz, and Gabriel Oliver · 2008
Earlier work this paper cites.
On the segmentation of 3d lidar point clouds
Bertrand Douillard, James Underwood, Noah Kuntz, Vsevolod Vlaskine, Alastair Quadros, Peter Morton, and Alon Frenkel · 2011
Earlier work this paper cites.
Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera
Shahram Izadi, David Kim, Otmar Hilliges, David Molyneaux, Richard Newcombe, Pushmeet Kohli, Jamie Shotton, Steve Hodges, Dustin Freeman, Andrew Davison, et al · 2011
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012
Earlier work this paper cites.
Dense 3d semantic mapping of indoor scenes from rgb-d images
Alexander Hermans, Georgios Floros, and Bastian Leibe · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Unsupervised feature learning for 3d scene labeling
K. Lai, L. Bo, and D. Fox · 2014
Earlier work this paper cites.
Microsoft coco: Common objects in context
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick · 2014
Earlier work this paper cites.
Shapenet: An information-rich 3d model repository
Angel X Chang, Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, et al · 2015
Earlier work this paper cites.
Fully convolutional networks for semantic segmentation
Jonathan Long, Evan Shelhamer, and Trevor Darrell · 2015
Earlier work this paper cites.
Geodesic convolutional neural networks on riemannian manifolds
Jonathan Masci, Davide Boscaini, Michael Bronstein, and Pierre Vandergheynst · 2015
Earlier work this paper cites.
U-net: Convolutional networks for biomedical image segmentation
Olaf Ronneberger, Philipp Fischer, and Thomas Brox · 2015
Earlier work this paper cites.
U-net: Convolutional networks for biomedical image segmentation
Olaf Ronneberger, Philipp Fischer, and Thomas Brox · 2015
Earlier work this paper cites.
Learning spatiotemporal features with 3d convolutional networks
Du Tran, Lubomir Bourdev, Rob Fergus, Lorenzo Torresani, and Manohar Paluri · 2015
Earlier work this paper cites.
Incremental dense semantic stereo fusion for large-scale semantic scene reconstruction
Vibhav Vineet, Ondrej Miksik, Morten Lidegaard, Matthias Nießner, Stuart Golodetz, Victor A Prisacariu, Olaf Kähler, David W Murray, Shahram Izadi, Patrick Pérez, et al · 2015
Earlier work this paper cites.
Soundnet: Learning sound representations from unlabeled video
Yusuf Aytar, Carl Vondrick, and Antonio Torralba · 2016
Earlier work this paper cites.
3d u-net: learning dense volumetric segmentation from sparse annotation
Özgün Çiçek, Ahmed Abdulkadir, Soeren S Lienkamp, Thomas Brox, and Olaf Ronneberger · 2016
Earlier work this paper cites.
Cross modal distillation for supervision transfer
Saurabh Gupta, Judy Hoffman, and Jitendra Malik · 2016
Earlier work this paper cites.
Ambient sound provides supervision for visual learning
Andrew Owens, Jiajun Wu, Josh H. McDermott, William T. Freeman, and Antonio Torralba · 2016
Earlier work this paper cites.
Segnet: A deep convolutional encoder-decoder architecture for image segmentation
Vijay Badrinarayanan, Alex Kendall, and Roberto Cipolla · 2017
Earlier work this paper cites.
Matterport3d: Learning from rgb-d data in indoor environments
Angel Chang, Angela Dai, Thomas Funkhouser, Maciej Halber, Matthias Niessner, Manolis Savva, Shuran Song, Andy Zeng, and Yinda Zhang · 2017
Earlier work this paper cites.
Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs
Liang-Chieh Chen, George Papandreou, Iasonas Kokkinos, Kevin Murphy, and Alan L Yuille · 2017
Earlier work this paper cites.
Rethinking atrous convolution for semantic image segmentation
Liang-Chieh Chen, George Papandreou, Florian Schroff, and Hartwig Adam · 2017
Earlier work this paper cites.
Xception: Deep learning with depthwise separable convolutions
François Chollet · 2017
Earlier work this paper cites.
Scannet: Richly-annotated 3d reconstructions of indoor scenes
Angela Dai, Angel X Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, and Matthias Nießner · 2017
Earlier work this paper cites.
Submanifold sparse convolutional networks
Benjamin Graham and Laurens van der Maaten · 2017
Earlier work this paper cites.
Clevr: A diagnostic dataset for compositional language and elementary visual reasoning
Justin Johnson, Bharath Hariharan, Laurens Van Der Maaten, Li Fei-Fei, C Lawrence Zitnick, and Ross Girshick · 2017
Earlier work this paper cites.
Deep projective 3d semantic segmentation
Felix Järemo Lawin, Martin Danelljan, Patrik Tosteberg, Goutam Bhat, Fahad Shahbaz Khan, and Michael Felsberg · 2017
Earlier work this paper cites.
Multi-view deep learning for consistent semantic mapping with rgb-d cameras
Lingni Ma, Jörg Stückler, Christian Kerl, and Daniel Cremers · 2017
Earlier work this paper cites.
Semanticfusion: Dense 3d semantic mapping with convolutional neural networks
John McCormac, Ankur Handa, Andrew Davison, and Stefan Leutenegger · 2017
Earlier work this paper cites.
Pointnet: Deep learning on point sets for 3d classification and segmentation
Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas · 2017
Earlier work this paper cites.
Pointnet++: Deep hierarchical feature learning on point sets in a metric space
Charles Ruizhongtai Qi, Li Yi, Hao Su, and Leonidas J Guibas · 2017
Earlier work this paper cites.
Octnet: Learning deep 3d representations at high resolutions
Gernot Riegler, Ali Osman Ulusoy, and Andreas Geiger · 2017
Earlier work this paper cites.
Semantic scene completion from a single depth image
Shuran Song, Fisher Yu, Andy Zeng, Angel X Chang, Manolis Savva, and Thomas Funkhouser · 2017
Earlier work this paper cites.
Blender - a 3D modelling and rendering package
Blender Online Community · 2018
Earlier work this paper cites.
3dmv: Joint 3d-multi-view prediction for 3d semantic scene segmentation
Angela Dai and Matthias Nießner · 2018
Earlier work this paper cites.
Scancomplete: Large-scale scene completion and semantic segmentation for 3d scans
Angela Dai, Daniel Ritchie, Martin Bokeloh, Scott Reed, Jürgen Sturm, and Matthias Nießner · 2018
Earlier work this paper cites.
Looking to listen at the cocktail party: A speaker-independent audio-visual model for speech separation
Ariel Ephrat, Inbar Mosseri, Oran Lang, Tali Dekel, Kevin Wilson, Avinatan Hassidim, William T. Freeman, and Michael Rubinstein · 2018
Earlier work this paper cites.
3d semantic segmentation with submanifold sparse convolutional networks
Benjamin Graham, Martin Engelcke, and Laurens van der Maaten · 2018
Earlier work this paper cites.
AtlasNet: A Papier-Mâché Approach to Learning 3D Surface Generation
Thibault Groueix, Matthew Fisher, Vladimir G. Kim, Bryan C. Russell, and Mathieu Aubry · 2018
Earlier work this paper cites.
Cooperative learning of audio and video models from self-supervised synchronization
Bruno Korbar, Du Tran, and Lorenzo Torresani · 2018
Earlier work this paper cites.
The need 4 speed in real-time dense visual tracking
Adarsh Kowdle, Christoph Rhemann, Sean Fanello, Andrea Tagliasacchi, Jonathan Taylor, Philip Davidson, Mingsong Dou, Kaiwen Guo, Cem Keskin, Sameh Khamis, et al · 2018
Earlier work this paper cites.
The sound of pixels
Hang Zhao, Chuang Gan, Andrew Rouditchenko, Carl Vondrick, Josh McDermott, and Antonio Torralba · 2018
Earlier work this paper cites.
3d scene graph: A structure for unified semantics, 3d space, and camera
Iro Armeni, Zhi-Yang He, JunYoung Gwak, Amir R. Zamir, Martin Fischer, Jitendra Malik, and Silvio Savarese · 2019
Earlier work this paper cites.
Trends and challenges in robot manipulation
Aude Billard and Danica Kragic · 2019
Earlier work this paper cites.
Object recognition, segmentation, and classification of mobile laser scanning point clouds: A state of the art review
Erzhuo Che, Jaehoon Jung, and Michael J Olsen · 2019
Earlier work this paper cites.
Learning implicit fields for generative shape modeling
Zhiqin Chen and Hao Zhang · 2019
Earlier work this paper cites.
Learning Implicit Fields for Generative Shape Modeling
Zhiqin Chen and Hao Zhang · 2019
Earlier work this paper cites.
4d spatio-temporal convnets: Minkowski convolutional neural networks
Christopher Choy, JunYoung Gwak, and Silvio Savarese · 2019
Earlier work this paper cites.
4d spatio-temporal convnets: Minkowski convolutional neural networks
Christopher Choy, JunYoung Gwak, and Silvio Savarese · 2019
Cited alongside, same era.
Fully convolutional geometric features
Christopher Choy, Jaesik Park, and Vladlen Koltun · 2019
Cited alongside, same era.
Self-supervised moving vehicle tracking with stereo sound
Chuang Gan, Hang Zhao, Peihao Chen, David Cox, and Antonio Torralba · 2019
Cited alongside, same era.
Learning Shape Templates with Structured Implicit Functions
Kyle Genova, Forrester Cole, Daniel Vlasic, Aaron Sarna, William Freeman, and Thomas Funkhouser · 2019
Cited alongside, same era.
Distinit: Learning video representations without a single labeled video
Rohit Girdhar, Du Tran, Lorenzo Torresani, and Deva Ramanan · 2019
Cited alongside, same era.
Meshcnn: a network with an edge
Rana Hanocka, Amir Hertz, Noa Fish, Raja Giryes, Shachar Fleishman, and Daniel Cohen-Or · 2019
PV-RCNN: Point-voxel feature set abstraction for 3d object detection
Shaoshuai Shi, Chaoxu Guo, Li Jiang, Zhe Wang, Jianping Shi, Xiaogang Wang, and Hongsheng Li · 2020
Later among the works it cites.
Scalability in perception for autonomous driving: Waymo open dataset
Pei Sun, Henrik Kretzschmar, Xerxes Dotiwalla, Aurelien Chouard, Vijaysai Patnaik, Paul Tsui, James Guo, Yin Zhou, Yuning Chai, Benjamin Caine, et al · 2020
Later among the works it cites.
Contrastive multiview coding
Yonglong Tian, Dilip Krishnan, and Phillip Isola · 2020
Later among the works it cites.
Pointpainting: Sequential fusion for 3d object detection
Sourabh Vora, Alex H Lang, Bassam Helou, and Oscar Beijbom · 2020
Later among the works it cites.
Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance
Lior Yariv, Yoni Kasten, Dror Moran, Meirav Galun, Matan Atzmon, Ronan Basri, and Yaron Lipman · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Texturenet: Consistent local parametrizations for learning from high-resolution signals on meshes
Jingwei Huang, Haotian Zhang, Li Yi, Thomas Funkhouser, Matthias Nießner, and Leonidas J Guibas · 2019
Cited alongside, same era.
Multi-view pointnet for 3d scene understanding
Maximilian Jaritz, Jiayuan Gu, and Hao Su · 2019
Cited alongside, same era.
Survey on semantic segmentation using deep learning techniques
Fahad Lateef and Yassine Ruichek · 2019
Cited alongside, same era.
Deep learning on point clouds and its application: A survey
Weiping Liu, Jia Sun, Wanyi Li, Ting Hu, and Peng Wang · 2019
Cited alongside, same era.
Occupancy networks: Learning 3d reconstruction in function space
Lars Mescheder, Michael Oechsle, Michael Niemeyer, Sebastian Nowozin, and Andreas Geiger · 2019
Cited alongside, same era.
Occupancy Networks: Learning 3D Reconstruction in Function Space
Lars Mescheder, Michael Oechsle, Michael Niemeyer, Sebastian Nowozin, and Andreas Geiger · 2019
Cited alongside, same era.
Yang Zhang, Zixiang Zhou, Philip David, Xiangyu Yue, Zerong Xi, Boqing Gong, and Hassan Foroosh · 2020
Later among the works it cites.
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
Jonathan Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, and Pratul Srinivasan · 2021
Closest in time.
NeRD: Neural Reflectance Decomposition from Image Collections
Mark Boss, Raphael Braun, Varun Jampani, Jonathan Barron, Ce Liu, and Hendrik Lensch · 2021
Closest in time.
MVSNeRF: Fast Generalizable Radiance Field Reconstruction From Multi-View Stereo
Anpei Chen and Zexiang Xu · 2021
Closest in time.
(af)2-s3net: Attentive feature fusion with adaptive feature selection for sparse semantic segmentation network
Ran Cheng, Ryan Razani, Ehsan Taghavi, Enxu Li, and Bingbing Liu · 2021
Closest in time.
Differentiable surface rendering via non-differentiable sampling
Forrester Cole, Kyle Genova, Avneesh Sud, Daniel Vlasic, and Zhoutong Zhang · 2021
Closest in time.
Unconstrained Scene Generation With Locally Conditioned Radiance Fields
Terrance DeVries · 2021
Closest in time.
FastNeRF: High-Fidelity Neural Rendering at 200FPS
Stephan Garbin and Marek Kowalski · 2021
Closest in time.
Learning 3d semantic segmentation with only 2d image supervision
Kyle Genova, Xiaoqi Yin, Abhijit Kundu, Caroline Pantofaru, Forrester Cole, Avneesh Sud, Brian Brewington, Brian Shucker, and Thomas Funkhouser · 2021
Closest in time.
Deep learning based 3d segmentation: A survey
Yong He, Hongshan Yu, Xiaoyan Liu, Zhengeng Yang, Wei Sun, Yaonan Wang, Qiang Fu, Yanmei Zou, and Ajmal Mian · 2021
Closest in time.
Baking Neural Radiance Fields for Real-Time View Synthesis
Peter Hedman, Pratul Srinivasan, Ben Mildenhall, Jonathan Barron, and Paul Debevec · 2021
Closest in time.
Unsupervised Learning of 3D Object Categories from Videos in the Wild
Philipp Henzler · 2021
Closest in time.
Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis
Ajay Jain, Matthew Tancik, and Pieter Abbeel · 2021
Closest in time.
CodeNeRF: Disentangled Neural Radiance Fields for Object Categories
Wongbong Jang and Lourdes Agapito · 2021
Closest in time.
Self-Calibrating Neural Radiance Fields
Yoonwoo Jeong · 2021
Closest in time.
NeRF-VAE: A Geometry Aware 3D Scene Generative Model
Adam Kosiorek, Heiko Strathmann, Daniel Zoran, Pol Moreno, Rosalia Schneider, Sona Mokrá, and Danilo Rezende · 2021
Closest in time.
BARF: Bundle-Adjusting Neural Radiance Fields
Chen-Hsuan Lin, Wei-Chiu Ma, Antonio Torralba, and Simon Lucey · 2021
Closest in time.
AutoInt: Automatic Integration for Fast Neural Volume Rendering
David Lindell, Julien Martel, and Gordon Wetzstein · 2021
Closest in time.
NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections
Ricardo Martin-Brualla, Noha Radwan, Mehdi Sajjadi, Jonathan Barron, Alexey Dosovitskiy, and Daniel Duckworth · 2021
Closest in time.
Diffuser: Multi-view 2d-to-3d label diffusion for semantic scene segmentation
Ruben Mascaro, Lucas Teixeira, and Margarita Chli · 2021
Closest in time.
GNeRF: GAN-Based Neural Radiance Field Without Posed Camera
Quan Meng · 2021
Closest in time.
Image segmentation using deep learning: A survey
Shervin Minaee, Yuri Y Boykov, Fatih Porikli, Antonio J Plaza, Nasser Kehtarnavaz, and Demetri Terzopoulos · 2021
Closest in time.
DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks
Thomas Neff · 2021
Closest in time.
GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields
Michael Niemeyer and Andreas Geiger · 2021
Closest in time.
Neural Articulated Radiance Field
Atsuhiro Noguchi · 2021
Closest in time.
UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction
Michael Oechsle, Songyou Peng, and Andreas Geiger · 2021
Closest in time.
Nerfies: Deformable Neural Radiance Fields
Keunhong Park, Utkarsh Sinha, Jonathan Barron, Sofien Bouaziz, Dan Goldman, Steven Seitz, and Ricardo Martin-Brualla · 2021
Closest in time.
Neural body: Implicit neural representations with structured latent codes for novel view synthesis of dynamic humans
Sida Peng · 2021
Closest in time.
KiloNeRF: Speeding Up Neural Radiance Fields With Thousands of Tiny MLPs
Christian Reiser, Songyou Peng, Yiyi Liao, and Andreas Geiger · 2021
Closest in time.
ShaRF: Shape-conditioned Radiance Fields from a Single View
Konstantinos Rematas, Ricardo Martin-Brualla, and Vittorio Ferrari · 2021
Closest in time.
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis
Pratul Srinivasan, Boyang Deng, Xiuming Zhang, Matthew Tancik, Ben Mildenhall, and Jonathan Barron · 2021
Closest in time.
iMAP: Implicit Mapping and Positioning in Real-Time
Edgar Sucar, Shikun Liu, Joseph Ortiz, and Andrew Davison · 2021
Closest in time.
Neural geometric level of detail: Real-time rendering with implicit 3d shapes
Towaki Takikawa · 2021
Closest in time.
Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video
Edgar Tretschk, Ayush Tewari, Vladislav Golyanik, Michael Zollhöfer, Christoph Lassner, and Christian Theobalt · 2021
Closest in time.
IBRNet: Learning Multi-View Image-Based Rendering
Qianqian Wang, Zhicheng Wang, Kyle Genova, Pratul Srinivasan, Howard Zhou, Jonathan Barron, Ricardo Martin-Brualla, Noah Snavely, and Thomas Funkhouser · 2021
Closest in time.
NeRF–: Neural Radiance Fields Without Known Camera Parameters
Zirui Wang, Shangzhe Wu, Weidi Xie, Min Chen, and Victor Adrian Prisacariu · 2021
Closest in time.
iNeRF: Inverting Neural Radiance Fields for Pose Estimation
Lin Yen-Chen, Pete Florence, Jonathan Barron, Alberto Rodriguez, Phillip Isola, and Tsung-Yi Lin · 2021
Closest in time.
PlenOctrees for Real-Time Rendering of Neural Radiance Fields
Alex Yu, Ruilong Li, Matthew Tancik, Hao Li, Ren Ng, and Angjoo Kanazawa · 2021
Closest in time.
pixelNeRF: Neural Radiance Fields from One or Few Images
Alex Yu, Vickie Ye, Matthew Tancik, and Angjoo Kanazawa · 2021
Closest in time.
STaR: Self-supervised Tracking and Reconstruction of Rigid Objects in Motion with Neural Rendering
Wentao Yuan, Zhaoyang Lv, Tanner Schmidt, and Steven Lovegrove · 2021
Closest in time.
Hdri haven
Greg Zaal, Rob Tuytel, Rico Cilliers, James Ray Cock, Andreas Mischok, Sergej Majboroda, Dimitrios Savva, and Jurita Burger · 2021
Closest in time.
Nerfactor: Neural factorization of shape and reflectance under an unknown illumination
Xiuming Zhang, Pratul P Srinivasan, Boyang Deng, Paul Debevec, William T Freeman, and Jonathan T Barron · 2021
Closest in time.
In-Place Scene Labelling and Understanding with Implicit Scene Representation
Shuaifeng Zhi, Tristan Laidlow, Stefan Leutenegger, and Andrew Davison · 2021
Closest in time.
Cylindrical and asymmetrical 3d convolution networks for lidar segmentation
Xinge Zhu, Hui Zhou, Tai Wang, Fangzhou Hong, Yuexin Ma, Wei Li, Hongsheng Li, and Dahua Lin · 2021
Closest in time.