2019

BSP-Net: Generating Compact Meshes via Binary Space Partitioning

Chen, Zhiqin, Tagliasacchi, Andrea, Zhang, Hao

Understand

Polygonal meshes are ubiquitous in the digital 3D domain, yet they have only played a minor role in the deep learning revolution.

Leading methods for learning generative models of shapes rely on implicit functions, and generate meshes only after expensive iso-surfacing routines.
To overcome these challenges, we are inspired by a classical spatial data structure from computer graphics, Binary Space Partitioning (BSP), to facilitate 3D learning.
The core ingredient of BSP is an operation for recursive subdivision of space to obtain convex sets.

Built on

Study for applying computer-generated images to visual simulation
R Schumacher · 1969
Earlier work this paper cites.
On visible surface generation by a priori tree structures
Henry Fuchs, Zvi M Kedem, and Bruce F Naylor · 1980
Earlier work this paper cites.
Marching cubes: A high resolution 3d surface construction algorithm
William E. Lorensen and Harvey E. Cline · 1987
Earlier work this paper cites.
Approximation capabilities of multilayer feedforward networks
Kurt Hornik · 1991
Earlier work this paper cites.
On visual similarity based 3d model retrieval
Ding-Yun Chen, Xiao-Pei Tian, Yu-Te Shen, and Ming Ouhyoung · 2003
Earlier work this paper cites.
ShapeNet: An information-rich 3D model repository
Original
Angel X. Chang, Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, Jianxiong Xiao, Li Yi, and Fisher Yu · 2015
Earlier work this paper cites.
Multi-view convolutional neural networks for 3d shape recognition
Hang Su, Subhransu Maji, Evangelos Kalogerakis, and Erik Learned-Miller · 2015
Earlier work this paper cites.
3d shapenets: A deep representation for volumetric shapes
Zhirong Wu, Shuran Song, Aditya Khosla, Fisher Yu, Linguang Zhang, Xiaoou Tang, and Jianxiong Xiao · 2015
Earlier work this paper cites.
3d-r2n2: A unified approach for single and multi-view 3d object reconstruction
Christopher B Choy, Danfei Xu, JunYoung Gwak, Kevin Chen, and Silvio Savarese · 2016
Earlier work this paper cites.
Learning a predictable and generative vector representation for objects
Rohit Girdhar, David F Fouhey, Mikel Rodriguez, and Abhinav Gupta · 2016
Earlier work this paper cites.
Binarized neural networks
Itay Hubara, Matthieu Courbariaux, Daniel Soudry, Ran El-Yaniv, and Yoshua Bengio · 2016
Earlier work this paper cites.
Xnor-net: Imagenet classification using binary convolutional neural networks
Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, and Ali Farhadi · 2016
Earlier work this paper cites.
Deep learning 3d shape surfaces using geometry images
Ayan Sinha, Jing Bai, and Karthik Ramani · 2016
Earlier work this paper cites.
Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling
Jiajun Wu, Chengkai Zhang, Tianfan Xue, Bill Freeman, and Josh Tenenbaum · 2016
Earlier work this paper cites.
A scalable active framework for region annotation in 3D shape collections
Li Yi, Vladimir G Kim, Duygu Ceylan, I Shen, Mengyan Yan, Hao Su, Cewu Lu, Qixing Huang, Alla Sheffer, Leonidas Guibas, et al · 2016
Earlier work this paper cites.
A point set generation network for 3d object reconstruction from a single image
Haoqiang Fan, Hao Su, and Leonidas J Guibas · 2017
Earlier work this paper cites.
Hierarchical surface prediction for 3d object reconstruction
Christian Häne, Shubham Tulsiani, and Jitendra Malik · 2017
Earlier work this paper cites.
Grass: Generative recursive autoencoders for shape structures
Jun Li, Kai Xu, Siddhartha Chaudhuri, Ersin Yumer, Hao Zhang, and Leonidas Guibas · 2017
Earlier work this paper cites.
Convolutional neural networks on surfaces via seamless toric covers
Haggai Maron, Meirav Galun, Noam Aigerman, Miri Trope, Nadav Dym, Ersin Yumer, Vladimir G. Kim, and Yaron Lipman · 2017
Earlier work this paper cites.
PointNet: Deep learning on point sets for 3D classification and segmentation
Charles R. Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas · 2017
Earlier work this paper cites.

Similar

PointNet++: Deep hierarchical feature learning on point sets in a metric space
Charles R. Qi, Li Yi, Hao Su, and Leonidas J Guibas · 2017
Cited alongside, same era.
Octnetfusion: Learning depth fusion from data
Gernot Riegler, Ali Osman Ulusoy, Horst Bischof, and Andreas Geiger · 2017
Cited alongside, same era.
Dynamic routing between capsules
Sara Sabour, Nicholas Frosst, and Geoffrey E. Hinton · 2017
Cited alongside, same era.
Surfnet: Generating 3d shape surfaces using deep residual networks
Ayan Sinha, Asim Unmesh, Qixing Huang, and Karthik Ramani · 2017
Cited alongside, same era.
Octree generating networks: Efficient convolutional architectures for high-resolution 3d outputs
Maxim Tatarchenko, Alexey Dosovitskiy, and Thomas Brox · 2017
Cited alongside, same era.
Learning shape abstractions by assembling volumetric primitives
Shubham Tulsiani, Hao Su, Leonidas J Guibas, Alexei A Efros, and Jitendra Malik · 2017
Cited alongside, same era.
O-CNN: Octree-based Convolutional Neural Networks for 3D Shape Analysis
Peng-Shuai Wang, Yang Liu, Yu-Xiao Guo, Chun-Yu Sun, and Xin Tong · 2017
Cited alongside, same era.
3D-PRNN: Generating shape primitives with recurrent neural networks
Chuhang Zou, Ersin Yumer, Jimei Yang, Duygu Ceylan, and Derek Hoiem · 2017
Cited alongside, same era.
Learning representations and generative models for 3d point clouds
Panos Achlioptas, Olga Diamanti, Ioannis Mitliagkas, and Leonidas J Guibas · 2018
Cited alongside, same era.
Multiresolution tree networks for 3d point cloud processing
Matheus Gadelha, Rui Wang, and Subhransu Maji · 2018
Cited alongside, same era.
3d semantic segmentation with submanifold sparse convolutional networks
Benjamin Graham, Martin Engelcke, and Laurens van der Maaten · 2018
Cited alongside, same era.
Atlasnet: A papier-mâché approach to learning 3d surface generation
Thibault Groueix, Matthew Fisher, Vladimir G. Kim, Bryan Russell, and Mathieu Aubry · 2018
Cited alongside, same era.

Then

Foldingnet: Point cloud auto-encoder via deep grid deformation
Yaoqing Yang, Chen Feng, Yiru Shen, and Dong Tian · 2018
Later among the works it cites.
P2P-NET: Bidirectional point displacement net for shape transform
Kangxue Yin, Hui Huang, Daniel Cohen-Or, and Hao Zhang · 2018
Later among the works it cites.
SCORES: Shape composition with recursive substructure priors
Chenyang Zhu, Kai Xu, Siddhartha Chaudhuri, Renjiao Yi, and Hao Zhang · 2018
Later among the works it cites.
BAE-NET: Branched autoencoder for shape co-segmentation
Zhiqin Chen, Kangxue Yin, Matthew Fisher, Siddhartha Chaudhuri, and Hao Zhang · 2019
Closest in time.
Learning implicit fields for generative shape modeling
Zhiqin Chen and Hao Zhang · 2019
Closest in time.
Scan2mesh: From unstructured range scans to 3d meshes
Angela Dai and Matthias Nießner · 2019
Closest in time.
Sparse data driven mesh deformation
Lin Gao, Yu-Kun Lai, Jie Yang, Ling-Xiao Zhang, Leif Kobbelt, and Shihong Xia · 2019
Closest in time.
SDM-NET: Deep generative network for structured deformable mesh
Lin Gao, Jie Yang, Tong Wu, Hongbo Fu, Yu-Kun Lai, and Hao Zhang · 2019
Closest in time.
Learning shape templates with structured implicit functions
Kyle Genova, Forrester Cole, Daniel Vlasic, Aaron Sarna, William T. Freeman, and Thomas Funkhouser · 2019
Closest in time.
MeshCNN: A network with an edge
Rana Hanocka, Amir Hertz, Noa Fish, Raja Giryes, Shachar Fleishman, and Daniel Cohen-Or · 2019
Closest in time.
DeepSDF: Learning continuous signed distance functions for shape representation
Jeong Joon Park, Peter Florence, Julian Straub, Richard Newcombe, and Steven Lovegrove · 2019
Closest in time.
Occupancy networks: Learning 3D reconstruction in function space
Lars Mescheder, Michael Oechsle, Michael Niemeyer, Sebastian Nowozin, and Andreas Geiger · 2019
Closest in time.
Structurenet: Hierarchical graph networks for 3d shape generation
Kaichun Mo, Paul Guerrero, Li Yi, Hao Su, Peter Wonka, Niloy Mitra, and Leonidas J Guibas · 2019
Closest in time.
PartNet: A large-scale benchmark for fine-grained and hierarchical part-level 3D object understanding
Kaichun Mo, Shilin Zhu, Angel X. Chang, Li Yi, Subarna Tripathi, Leonidas J. Guibas, and Hao Su · 2019
Closest in time.
Superquadrics revisited: Learning 3d shape parsing beyond cuboids
Despoina Paschalidou, Ali Osman Ulusoy, and Andreas Geiger · 2019
Closest in time.
Deep geometric prior for surface reconstruction
Francis Williams, Teseo Schneider, Claudio Silva, Denis Zorin, Joan Bruna, and Daniele Panozzo · 2019
Closest in time.
SAGNet: Structure-aware generative network for 3D-shape modeling
Zhijie Wu, Xiang Wang, Di Lin, Dani Lischinski, Daniel Cohen-Or, and Hui Huang · 2019
Closest in time.
DISN: deep implicit surface network for high-quality single-view 3d reconstruction
Qiangeng Xu, Weiyue Wang, Duygu Ceylan, Radomír Mech, and Ulrich Neumann · 2019
Closest in time.
LOGAN: Unpaired shape transform in latent overcomplete space
Kangxue Yin, Zhiqin Chen, Hui Huang, Daniel Cohen-Or, and Hao Zhang · 2019
Closest in time.
Cvxnets: Learnable convex decomposition
Boyang Deng, Kyle Genova, Soroosh Yazdani, Sofien Bouaziz, Geoffrey Hinton, and Andrea Tagliasacchi · 2020
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…