Fetching the paper…
Reading the bibliography…
We present SceneFactor, a diffusion-based approach for large-scale 3D scene generation that enables controllable generation and effortless editing.
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber · 1997
Earlier work this paper cites.
Denoising diffusion probabilistic models
Jonathan Ho, Ajay Jain, and P. Abbeel · 2006
Earlier work this paper cites.
Shapenet: An information-rich 3d model repository
Angel X Chang, Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, et al · 2015
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik Kingma and Jimmy Ba · 2015
Earlier work this paper cites.
Deep unsupervised learning using nonequilibrium thermodynamics
Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli · 2015
Earlier work this paper cites.
Empirical evaluation of rectified activations in convolutional network
Bing Xu, Naiyan Wang, Tianqi Chen, and Mu Li · 2015
Earlier work this paper cites.
Gaussian error linear units (gelus)
Dan Hendrycks and Kevin Gimpel · 2016
Earlier work this paper cites.
Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling
Jiajun Wu, Chengkai Zhang, Tianfan Xue, Bill Freeman, and Joshua B. Tenenbaum · 2016
Earlier work this paper cites.
Decoupled weight decay regularization
Ilya Loshchilov and Frank Hutter · 2017
Earlier work this paper cites.
Neural discrete representation learning
Aaron Van Den Oord, Oriol Vinyals, et al · 2017
Earlier work this paper cites.
Robust watertight manifold surface generation method for shapenet models
Jingwei Huang, Hao Su, and Leonidas Guibas · 2018
Earlier work this paper cites.
Grains: Generative recursive autoencoders for indoor scenes
Manyi Li, Akshay Gadi Patil, Kai Xu, Siddhartha Chaudhuri, Owais Khan, Ariel Shamir, Changhe Tu, Baoquan Chen, Daniel Cohen-Or, and Hao Zhang · 2018
Earlier work this paper cites.
Deep convolutional priors for indoor scene synthesis
Kai Wang, Manolis Savva, Angel X Chang, and Daniel Ritchie · 2018
Earlier work this paper cites.
Shapeglot: Learning language for shape differentiation
Panos Achlioptas, Judy Fan, Robert Hawkins, Noah Goodman, and Leonidas J Guibas · 2019
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2019
Earlier work this paper cites.
Pointflow: 3d point cloud generation with continuous normalizing flows
G. Yang, X. Huang, Z. Hao, M. Liu, S. Belongie, and B. Hariharan · 2019
Earlier work this paper cites.
Learning generative models of 3d structures
Siddhartha Chaudhuri, Daniel Ritchie, Jiajun Wu, Kai Xu, and Hao Zhang · 2020
Earlier work this paper cites.
Polygen: An autoregressive generative model of 3d meshes
Charlie Nash, Yaroslav Ganin, SM Ali Eslami, and Peter Battaglia · 2020
Earlier work this paper cites.
Graph-to-3d: End-to-end generation and manipulation of 3d scenes using scene graphs
Helisa Dhamo, Fabian Manhardt, Nassir Navab, and Federico Tombari · 2021
Earlier work this paper cites.
Diffusion models beat gans on image synthesis
Prafulla Dhariwal and Alex Nichol · 2021
Earlier work this paper cites.
Atiss: Autoregressive transformers for indoor scene synthesis
Despoina Paschalidou, Amlan Kar, Maria Shugrina, Karsten Kreis, Andreas Geiger, and Sanja Fidler · 2021
Earlier work this paper cites.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever · 2021
Earlier work this paper cites.
High-resolution image synthesis with latent diffusion models, 2021
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2021
Earlier work this paper cites.
3d shape generation and completion through point-voxel diffusion
Linqi Zhou, Yilun Du, and Jiajun Wu · 2021
Earlier work this paper cites.
Blended diffusion for text-driven editing of natural images
Omri Avrahami, Dani Lischinski, and Ohad Fried · 2022
Earlier work this paper cites.
Text2live: Text-driven layered image and video editing
Omer Bar-Tal, Dolev Ofri-Amar, Rafail Fridman, Yoni Kasten, and Tali Dekel · 2022
Earlier work this paper cites.
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation
Matt Deitke, Eli VanderBilt, Alvaro Herrasti, Luca Weihs, Jordi Salvador, Kiana Ehsani, Winson Han, Eric Kolve, Ali Farhadi, Aniruddha Kembhavi, and Roozbeh Mottaghi · 2022
Cited alongside, same era.
Clip-mesh: Generating textured meshes from text using pretrained image-text models
Nasir Mohammad Khalid, Tianhao Xie, Eugene Belilovsky, and Popa Tiberiu · 2022
Cited alongside, same era.
Editvae: Unsupervised parts-aware controllable 3d point cloud shape generation
Shidi Li, Miaomiao Liu, and Christian Walder · 2022
Cited alongside, same era.
Repaint: Inpainting using denoising diffusion probabilistic models
Andreas Lugmayr, Martin Danelljan, Andres Romero, Fisher Yu, Radu Timofte, and Luc Van Gool · 2022
Cited alongside, same era.
AutoSDF: Shape priors for 3d completion, reconstruction and generation
Paritosh Mittal, Yen-Chi Cheng, Maneesh Singh, and Shubham Tulsiani · 2022
Cited alongside, same era.
Difffacto: Controllable part-based 3d point cloud generation with cross diffusion
Kiyohiro Nakayama, Mikaela Angelina Uy, Jiahui Huang, Shi-Min Hu, Ke Li, and Leonidas Guibas · 2023
Later among the works it cites.
Learning 3d scene priors with 2d supervision
Yinyu Nie, Angela Dai, Xiaoguang Han, and Matthias Nießner · 2023
Later among the works it cites.
Advances in data‐driven analysis and synthesis of 3d indoor scenes
Akshay Patil, Supriya Patil, Manyi Li, Matthew Fisher, and Manolis Savva · 2023
Later among the works it cites.
Scalable diffusion models with transformers
William Peebles and Saining Xie · 2023
Later among the works it cites.
3d neural field generation using triplane diffusion, 2023
J Ryan Shue, Eric Ryan Chan, Ryan Po, Zachary Ankner, Jiajun Wu, , and Gordon Wetzstein · 2023
Later among the works it cites.
Roomdreamer: Text-driven 3d indoor scene synthesis with coherent geometry and texture, 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Ben Poole, Ajay Jain, Jonathan T. Barron, and Ben Mildenhall · 2022
Cited alongside, same era.
3d-aware indoor scene synthesis with depth priors
Zifan Shi, Yujun Shen, Jiapeng Zhu, Dit-Yan Yeung, and Qifeng Chen · 2022
Cited alongside, same era.
Dual octree graph networks for learning adaptive volumetric shape representations
Peng-Shuai Wang, Yang Liu, and Xin Tong · 2022
Cited alongside, same era.
Shapeformer: Transformer-based shape completion via sparse representation
Xingguang Yan, Liqiang Lin, Niloy J. Mitra, Dani Lischinski, Danny Cohen-Or, and Hui Huang · 2022
Cited alongside, same era.
Fast 3d indoor scene synthesis by learning spatial relation priors of objects
Song-Hai Zhang, Shao-Kui Zhang, Wei-Yu Xie, Cheng-Yang Luo, Yong-Liang Yang, and Hongbo Fu · 2022
Cited alongside, same era.
Cc3d: Layout-conditioned generation of compositional 3d scenes
Sherwin Bahmani, Jeong Joon Park, Despoina Paschalidou, Xingguang Yan, Gordon Wetzstein, Leonidas Guibas, and Andrea Tagliasacchi · 2023
Cited alongside, same era.
GeNVS: Generative novel view synthesis with 3D-aware diffusion models
Eric R. Chan, Koki Nagano, Matthew A. Chan, Alexander W. Bergman, Jeong Joon Park, Axel Levy, Miika Aittala, Shalini De Mello, Tero Karras, and Gordon Wetzstein · 2023
Cited alongside, same era.
Liangchen Song, Liangliang Cao, Hongyu Xu, Kai Kang, Feng Tang, Junsong, Yuan, and Yang Zhao · 2023
Later among the works it cites.
Dual diffusion implicit bridges for image-to-image translation
Xuan Su, Jiaming Song, Chenlin Meng, and Stefano Ermon · 2023
Later among the works it cites.
Generating part-aware editable 3d shapes without 3d supervision
Konstantinos Tertikas, Despoina Paschalidou, Boxiao Pan, Jeong Joon Park, Mikaela Angelina Uy, Ioannis Emiris, Yannis Avrithis, and Leonidas Guibas · 2023
Later among the works it cites.
Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distillation
Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongxuan Li, Hang Su, and Jun Zhu · 2023
Later among the works it cites.
Lego-net: Learning regular rearrangements of objects in rooms
Qiuhong Anna Wei, Sijie Ding, Jeong Joon Park, Rahul Sajnani, Adrien Poulenard, Srinath Sridhar, and Leonidas Guibas · 2023
Later among the works it cites.
Holodeck: Language guided generation of 3d embodied ai environments
Yue Yang, Fan-Yun Sun, Luca Weihs, Eli VanderBilt, Alvaro Herrasti, Winson Han, Jiajun Wu, Nick Haber, Ranjay Krishna, Lingjie Liu, Chris Callison-Burch, Mark Yatskar, Aniruddha Kembhavi, and Christopher Clark · 2023
Later among the works it cites.
Commonscenes: Generating commonsense 3d indoor scenes with scene graph diffusion
Guangyao Zhai, Evin Pınar Örnek, Shun-Cheng Wu, Yan Di, Federico Tombari, Nassir Navab, and Benjamin Busam · 2023
Later among the works it cites.
Michelangelo: Conditional 3d shape generation based on shape-image-text aligned latent representation
Zibo Zhao, Wen Liu, Xin Chen, Xianfang Zeng, Rui Wang, Pei Cheng, BIN FU, Tao Chen, Gang YU, and Shenghua Gao · 2023
Later among the works it cites.
Locally attentional sdf diffusion for controllable 3d shape generation
Xin-Yang Zheng, Hao Pan, Peng-Shuai Wang, Xin Tong, Yang Liu, and Heung-Yeung Shum · 2023
Later among the works it cites.
Open-universe indoor scene generation using llm program synthesis and uncurated object databases
Rio Aguina-Kang, Maxim Gumin, Do Heon Han, Stewart Morris, Seung Jean Yoo, Aditya Ganeshan, R. K. Jones, Qiuhong Anna Wei, Kailiang Fu, and Daniel Ritchie · 2024
Closest in time.
Turboedit: Text-based image editing using few-step diffusion models, 2024
Gilad Deutch, Rinon Gal, Daniel Garibi, Or Patashnik, and Daniel Cohen-Or · 2024
Closest in time.
Semcity: Semantic scene generation with triplane diffusion
Jumin Lee, Sebin Lee, Changho Jo, Woobin Im, Juhyeong Seon, and Sung-Eui Yoon · 2024
Closest in time.
Xcube: Large-scale 3d generative modeling using sparse voxel hierarchies
Xuanchi Ren, Jiahui Huang, Xiaohui Zeng, Ken Museth, Sanja Fidler, and Francis Williams · 2024
Closest in time.
Geodiffuser: Geometry-based image editing with diffusion models, 2024
Rahul Sajnani, Jeroen Vanbaar, Jie Min, Kapil Katyal, and Srinath Sridhar · 2024
Closest in time.
Controlroom3d: Room generation using semantic proxy rooms
Jonas Schult, Sam Tsai, Lukas Höllein, Bichen Wu, Jialiang Wang, Chih-Yao Ma, Kunpeng Li, Xiaofang Wang, Felix Wimbauer, Zijian He, Peizhao Zhang, Bastian Leibe, Peter Vajda, and Ji Hou · 2024
Closest in time.
Meshgpt: Generating triangle meshes with decoder-only transformers
Yawar Siddiqui, Antonio Alliegro, Alexey Artemov, Tatiana Tommasi, Daniele Sirigatti, Vladislav Rosov, Angela Dai, and Matthias Nießner · 2024
Closest in time.
Diffuscene: Denoising diffusion models for gerative indoor scene synthesis
Jiapeng Tang, Yinyu Nie, Lev Markhasin, Angela Dai, Justus Thies, and Matthias Nießner · 2024
Closest in time.
Introducing qwen1.5, 2024
Qwen Team · 2024
Closest in time.
Blockfusion: Expandable 3d scene generation using latent tri-plane extrapolation
Zhennan Wu, Yang Li, and Han Yan · 2024
Closest in time.
Frankenstein: Generating semantic-compositional 3d scenes in one tri-plane
Han Yan, Yang Li, Zhennan Wu, Shenzhou Chen, Weixuan Sun, Taizhang Shang, Weizhe Liu, Tian Chen, Xiaqiang Dai, Chao Ma, Hongdong Li, and Pan Ji · 2024
Closest in time.