Fetching the paper…
Reading the bibliography…
Existing diffusion-based text-to-3D generation methods primarily focus on producing visually realistic shapes and appearances, often neglecting the physical constraints necessary for downstream tasks.
Physically based modeling: Rigid body simulation
David Baraff · 2001
Earlier work this paper cites.
Make it stand: balancing shapes for 3d fabrication
Romain Prévost, Emily Whiting, Sylvain Lefebvre, and Olga Sorkine-Hornung · 2013
Earlier work this paper cites.
Automatic differentiation in pytorch
Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer · 2017
Earlier work this paper cites.
Introduction to quantum mechanics
David J Griffiths and Darrell F Schroeter · 2018
Earlier work this paper cites.
Physics-aware 3d mesh synthesis
Jianren Wang and Yihui He · 2019
Earlier work this paper cites.
Modular primitives for high-performance differentiable rendering
Samuli Laine, Janne Hellsten, Tero Karras, Yeongho Seol, Jaakko Lehtinen, and Timo Aila · 2020
Earlier work this paper cites.
Incremental potential contact: intersection-and inversion-free, large-deformation dynamics
Minchen Li, Zachary Ferguson, Teseo Schneider, Timothy R Langlois, Denis Zorin, Daniele Panozzo, Chenfanfu Jiang, and Danny M Kaufman · 2020
Earlier work this paper cites.
gradsim: Differentiable simulation for system identification and visuomotor control
J Krishna Murthy, Miles Macklin, Florian Golemo, Vikram Voleti, Linda Petrini, Martin Weiss, Breandan Considine, Jérôme Parent-Lévesque, Kevin Xie, Kenny Erleben, et al · 2020
Earlier work this paper cites.
3d design using generative adversarial networks and physics-based validation
Dule Shu, James Cunningham, Gary Stump, Simon W Miller, Michael A Yukish, Timothy W Simpson, and Conrad S Tucker · 2020
Earlier work this paper cites.
Learning body-aware 3d shape generative models
Bryce Blinn, Alexander Ding, R Kenny Jones, Manolis Savva, Srinath Sridhar, and Daniel Ritchie · 2021
Earlier work this paper cites.
Plasticinelab: A soft-body manipulation benchmark with differentiable physics
Zhiao Huang, Yuanming Hu, Tao Du, Siyuan Zhou, Hao Su, Joshua B Tenenbaum, and Chuang Gan · 2021
Earlier work this paper cites.
Diffusion probabilistic models for 3d point cloud generation
Shitong Luo and Wei Hu · 2021
Earlier work this paper cites.
Physically-aware generative network for 3d shape modeling
Mariem Mezghanni, Malika Boulkenafed, Andre Lieutier, and Maks Ovsjanikov · 2021
Earlier work this paper cites.
Nerf: Representing scenes as neural radiance fields for view synthesis
Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng · 2021
Earlier work this paper cites.
Efficient differentiable simulation of articulated bodies
Yi-Ling Qiao, Junbang Liang, Vladlen Koltun, and Ming C Lin · 2021
Earlier work this paper cites.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021
Earlier work this paper cites.
High-resolution image synthesis with latent diffusion models, 2021
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2021
Earlier work this paper cites.
Deep marching tetrahedra: a hybrid representation for high-resolution 3d shape synthesis
Tianchang Shen, Jun Gao, Kangxue Yin, Ming-Yu Liu, and Sanja Fidler · 2021
Earlier work this paper cites.
Diffsdfsim: Differentiable rigid-body dynamics with implicit shapes
Michael Strecke and Joerg Stueckler · 2021
Earlier work this paper cites.
Differentiable fluids with solid coupling for learning and control
Tetsuya Takahashi, Junbang Liang, Yi-Ling Qiao, and Ming C Lin · 2021
Earlier work this paper cites.
Neus: Learning neural implicit surfaces by volume rendering for multi-view reconstruction
Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, and Wenping Wang · 2021
Earlier work this paper cites.
Gaudi: A neural architect for immersive 3d scene generation
Miguel Angel Bautista, Pengsheng Guo, Samira Abnar, Walter Talbott, Alexander Toshev, Zhuoyuan Chen, Laurent Dinh, Shuangfei Zhai, Hanlin Goh, Daniel Ulbricht, et al · 2022
Earlier work this paper cites.
Virtual elastic objects
Hsiao-yu Chen, Edith Tretschk, Tuur Stuyck, Petr Kadlecek, Ladislav Kavan, Etienne Vouga, and Christoph Lassner · 2022
Earlier work this paper cites.
From data to functa: Your data point is a function and you can treat it like one
Emilien Dupont, Hyunjik Kim, SM Eslami, Danilo Rezende, and Dan Rosenbaum · 2022
Earlier work this paper cites.
Differentiable solver for time-dependent deformation problems with contact
Zizhou Huang, Davi Colli Tozoni, Arvi Gjoka, Zachary Ferguson, Teseo Schneider, Daniele Panozzo, and Denis Zorin · 2022
Earlier work this paper cites.
Affine body dynamics: Fast, stable & intersection-free simulation of stiff materials
Lei Lan, Danny M Kaufman, Minchen Li, Chenfanfu Jiang, and Yin Yang · 2022
Earlier work this paper cites.
Pac-nerf: Physics augmented continuum neural radiance fields for geometry-agnostic system identification
Xuan Li, Yi-Ling Qiao, Peter Yichen Chen, Krishna Murthy Jatavallabhula, Ming Lin, Chenfanfu Jiang, and Chuang Gan · 2022
Earlier work this paper cites.
Diffcloth: Differentiable cloth simulation with dry frictional contact
Yifei Li, Tao Du, Kui Wu, Jie Xu, and Wojciech Matusik · 2022
Earlier work this paper cites.
Warp: A high-performance python framework for gpu simulation and graphics
Miles Macklin · 2022
Earlier work this paper cites.
Physical simulation layer for accurate 3d modeling
Mariem Mezghanni, Théo Bodrito, Malika Boulkenafed, and Maks Ovsjanikov · 2022
Earlier work this paper cites.
Text2mesh: Text-driven neural stylization for meshes
Oscar Michel, Roi Bar-On, Richard Liu, Sagie Benaim, and Rana Hanocka · 2022
Earlier work this paper cites.
Dreamfusion: Text-to-3d using 2d diffusion
Ben Poole, Ajay Jain, Jonathan T Barron, and Ben Mildenhall · 2022
Earlier work this paper cites.
High-resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2022
Earlier work this paper cites.
Diffcloud: Real-to-sim from point clouds with differentiable simulation and rendering of deformable objects
Priya Sundaresan, Rika Antonova, and Jeannette Bohgl · 2022
Earlier work this paper cites.
Lion: Latent point diffusion models for 3d shape generation
Arash Vahdat, Francis Williams, Zan Gojcic, Or Litany, Sanja Fidler, Karsten Kreis, et al · 2022
Earlier work this paper cites.
Renderdiffusion: Image diffusion for 3d reconstruction, inpainting and generation
Titas Anciukevičius, Zexiang Xu, Matthew Fisher, Paul Henderson, Hakan Bilen, Niloy J Mitra, and Paul Guerrero · 2023
Earlier work this paper cites.
Large-vocabulary 3d diffusion model with transformer
Ziang Cao, Fangzhou Hong, Tong Wu, Liang Pan, and Ziwei Liu · 2023
Earlier work this paper cites.
Single-stage diffusion nerf: A unified approach to 3d generation and reconstruction
Hansheng Chen, Jiatao Gu, Anpei Chen, Wei Tian, Zhuowen Tu, Lingjie Liu, and Hao Su · 2023
Cited alongside, same era.
Fantasia3d: Disentangling geometry and appearance for high-quality text-to-3d content creation
Rui Chen, Yongwei Chen, Ningxin Jiao, and Kui Jia · 2023
Cited alongside, same era.
Hyperdiffusion: Generating implicit neural fields with weight-space diffusion
Ziya Erkoç, Fangchang Ma, Qi Shan, Matthias Nießner, and Angela Dai · 2023
Cited alongside, same era.
threestudio: A unified framework for 3d content generation
Yuan-Chen Guo, Ying-Tian Liu, Ruizhi Shao, Christian Laforte, Vikram Voleti, Guan Luo, Chia-Hao Chen, Zi-Xin Zou, Chen Wang, Yan-Pei Cao, and Song-Hai Zhang · 2023
Cited alongside, same era.
3dgen: Triplane latent diffusion for textured mesh generation
Anchit Gupta, Wenhan Xiong, Yixin Nie, Ian Jones, and Barlas Oğuz · 2023
Cited alongside, same era.
Consistent123: Improve consistency for one image to 3d object synthesis, 2023
Haohan Weng, Tianyu Yang, Jianan Wang, Yu Li, Tong Zhang, C. L. Philip Chen, and Lei Zhang · 2023
Later among the works it cites.
Physgaussian: Physics-integrated 3d gaussians for generative dynamics
Tianyi Xie, Zeshun Zong, Yuxin Qiu, Xuan Li, Yutao Feng, Yin Yang, and Chenfanfu Jiang · 2023
Later among the works it cites.
Dmv3d: Denoising multi-view diffusion using 3d large reconstruction model
Yinghao Xu, Hao Tan, Fujun Luan, Sai Bi, Peng Wang, Jiahao Li, Zifan Shi, Kalyan Sunkavalli, Gordon Wetzstein, Zexiang Xu, et al · 2023
Later among the works it cites.
Consistnet: Enforcing 3d consistency for multi-view images diffusion
Jiayu Yang, Ziang Cheng, Yunfei Duan, Pan Ji, and Hongdong Li · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Diffusion-based generation, optimization, and planning in 3d scenes
Siyuan Huang, Zan Wang, Puhao Li, Baoxiong Jia, Tengyu Liu, Yixin Zhu, Wei Liang, and Song-Chun Zhu · 2023
Cited alongside, same era.
Dreamtime: An improved optimization strategy for diffusion-guided 3d generation
Yukun Huang, Jianan Wang, Yukai Shi, Boshi Tang, Xianbiao Qi, and Lei Zhang · 2023
Cited alongside, same era.
Shap-e: Generating conditional 3d implicit functions
Heewoo Jun and Alex Nichol · 2023
Cited alongside, same era.
Holodiffusion: Training a 3d diffusion model using 2d images
Animesh Karnewar, Andrea Vedaldi, David Novotny, and Niloy J Mitra · 2023
Cited alongside, same era.
Instant3d: Fast text-to-3d with sparse-view generation and large reconstruction model
Jiahao Li, Hao Tan, Kai Zhang, Zexiang Xu, Fujun Luan, Yinghao Xu, Yicong Hong, Kalyan Sunkavalli, Greg Shakhnarovich, and Sai Bi · 2023
Cited alongside, same era.
Diffusion-sdf: Text-to-shape via voxelized diffusion
Muheng Li, Yueqi Duan, Jie Zhou, and Jiwen Lu · 2023
Cited alongside, same era.
Sweetdreamer: Aligning geometric priors in 2d diffusion for consistent text-to-3d
Weiyu Li, Rui Chen, Xuelin Chen, and Ping Tan · 2023
Cited alongside, same era.
Xiaofeng Yang, Yiwen Chen, Cheng Chen, Chi Zhang, Yi Xu, Xulei Yang, Fayao Liu, and Guosheng Lin · 2023
Later among the works it cites.
Consistent-1-to-3: Consistent image to 3d view synthesis via geometry-aware diffusion models
Jianglong Ye, Peng Wang, Kejie Li, Yichun Shi, and Heng Wang · 2023
Later among the works it cites.
Physdiff: Physics-guided human motion diffusion model
Ye Yuan, Jiaming Song, Umar Iqbal, Arash Vahdat, and Jan Kautz · 2023
Later among the works it cites.
Handypriors: Physically consistent perception of hand-object interactions with differentiable priors
Shutong Zhang, Yi-Ling Qiao, Guanglei Zhu, Eric Heiden, Dylan Turpin, Jingzhou Liu, Ming Lin, Miles Macklin, and Animesh Garg · 2023
Later among the works it cites.
Efficientdreamer: High-fidelity and robust 3d creation via orthogonal-view diffusion prior
Minda Zhao, Chaoyi Zhao, Xinyue Liang, Lincheng Li, Zeng Zhao, Zhipeng Hu, Changjie Fan, and Xin Yu · 2023
Later among the works it cites.
Free3d: Consistent novel view synthesis without 3d representation
Chuanxia Zheng and Andrea Vedaldi · 2023
Later among the works it cites.
Locally attentional sdf diffusion for controllable 3d shape generation
Xin-Yang Zheng, Hao Pan, Peng-Shuai Wang, Xin Tong, Yang Liu, and Heung-Yeung Shum · 2023
Later among the works it cites.
Sparsefusion: Distilling view-conditioned diffusion for 3d reconstruction
Zhizhuo Zhou and Shubham Tulsiani · 2023
Later among the works it cites.
Hifa: High-fidelity text-to-3d with advanced diffusion guidance
Joseph Zhu and Peiye Zhuang · 2023
Later among the works it cites.
V3d: Video diffusion models are effective 3d generators
Zilong Chen, Yikai Wang, Feng Wang, Zhengyi Wang, and Huaping Liu · 2024
Closest in time.
Gpld3d: Latent diffusion of 3d shape generative models by edupont2022datanforcing geometric and physical priors
Yuan Dong, Qi Zuo, Xiaodong Gu, Weihao Yuan, Zhengyi Zhao, Zilong Dong, Liefeng Bo, and Qixing Huang · 2024
Closest in time.
Debiasing scores and prompts of 2d diffusion for view-consistent text-to-3d generation
Susung Hong, Donghoon Ahn, and Seungryong Kim · 2024
Closest in time.
Vr-gs: A physical dynamics-aware interactive gaussian splatting system in virtual reality
Ying Jiang, Chang Yu, Tianyi Xie, Xuan Li, Yutao Feng, Huamin Wang, Minchen Li, Henry Lau, Feng Gao, Yin Yang, et al · 2024
Closest in time.
Noise-free score distillation
Oren Katzir, Or Patashnik, Daniel Cohen-Or, and Dani Lischinski · 2024
Closest in time.
Eschernet: A generative model for scalable view synthesis
Xin Kong, Shikun Liu, Xiaoyang Lyu, Marwan Taher, Xiaojuan Qi, and Andrew J Davison · 2024
Closest in time.
Dreampolisher: Towards high-quality text-to-3d generation via geometric diffusion
Yuanze Lin, Ronald Clark, and Philip Torr · 2024
Closest in time.
One-2-3-45: Any single image to 3d mesh in 45 seconds without per-shape optimization
Minghua Liu, Chao Xu, Haian Jin, Linghao Chen, Mukund Varma T, Zexiang Xu, and Hao Su · 2024
Closest in time.
Hexagen3d: Stablediffusion is just one step away from fast and diverse text-to-3d generation
Antoine Mercier, Ramin Nakhli, Mahesh Reddy, Rajeev Yasarla, Hong Cai, Fatih Porikli, and Guillaume Berger · 2024
Closest in time.
Dit-3d: Exploring plain diffusion transformers for 3d shape generation
Shentong Mo, Enze Xie, Ruihang Chu, Lanqing Hong, Matthias Niessner, and Zhenguo Li · 2024
Closest in time.
Phyrecon: Physically plausible neural scene reconstruction
Junfeng Ni, Yixin Chen, Bohan Jing, Nan Jiang, Bin Wang, Bo Dai, Yixin Zhu, Song-Chun Zhu, and Siyuan Huang · 2024
Closest in time.
Magic123: One image to high-quality 3d object generation using both 2d and 3d diffusion priors
Guocheng Qian, Jinjie Mai, Abdullah Hamdi, Jian Ren, Aliaksandr Siarohin, Bing Li, Hsin-Ying Lee, Ivan Skorokhodov, Peter Wonka, Sergey Tulyakov, and Bernard Ghanem · 2024
Closest in time.
Feature splatting: Language-driven physics-based scene synthesis and editing
Ri-Zhao Qiu, Ge Yang, Weijia Zeng, and Xiaolong Wang · 2024
Closest in time.
Sv3d: Novel multi-view synthesis and 3d generation from a single image using latent video diffusion
Vikram Voleti, Chun-Han Yao, Mark Boss, Adam Letts, David Pankratz, Dmitry Tochilkin, Christian Laforte, Robin Rombach, and Varun Jampani · 2024
Closest in time.
Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distillation
Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongxuan Li, Hang Su, and Jun Zhu · 2024
Closest in time.
Gpt-4v (ision) is a human-aligned evaluator for text-to-3d generation
Tong Wu, Guandao Yang, Zhibing Li, Kai Zhang, Ziwei Liu, Leonidas Guibas, Dahua Lin, and Gordon Wetzstein · 2024
Closest in time.
Precise-physics driven text-to-3d generation
Qingshan Xu, Jiao Liu, Melvin Wong, Caishun Chen, and Yew-Soon Ong · 2024
Closest in time.
Magic-boost: Boost 3d generation with mutli-view conditioned diffusion
Fan Yang, Jianfeng Zhang, Yichun Shi, Bowen Chen, Chenxu Zhang, Huichao Zhang, Xiaofeng Yang, Jiashi Feng, and Guosheng Lin · 2024
Closest in time.
Physcene: Physically interactable 3d scene synthesis for embodied ai
Yandan Yang, Baoxiong Jia, Peiyuan Zhi, and Siyuan Huang · 2024
Closest in time.
Holodeck: Language guided generation of 3d embodied ai environments
Yue Yang, Fan-Yun Sun, Luca Weihs, Eli VanderBilt, Alvaro Herrasti, Winson Han, Jiajun Wu, Nick Haber, Ranjay Krishna, Lingjie Liu, et al · 2024
Closest in time.
Diffusion time-step curriculum for one image to 3d generation
Xuanyu Yi, Zike Wu, Qingshan Xu, Pan Zhou, Joo-Hwee Lim, and Hanwang Zhang · 2024
Closest in time.
Text-to-3d with classifier score distillation
Xin Yu, Yuan-Chen Guo, Yangguang Li, Ding Liang, Song-Hai Zhang, and XIAOJUAN QI · 2024
Closest in time.
Physdreamer: Physics-based interaction with 3d objects via video generation
Tianyuan Zhang, Hong-Xing Yu, Rundi Wu, Brandon Y Feng, Changxi Zheng, Noah Snavely, Jiajun Wu, and William T Freeman · 2024
Closest in time.