Fetching the paper…
Reading the bibliography…
We present Farm3D, a method for learning category-specific 3D reconstructors for articulated objects, relying solely on "free" virtual supervision from a pre-trained 2D diffusion-based image generator.
A method for registration of 3-D shapes
Paul J. Besl and Neil D. McKay · 1992
Earlier work this paper cites.
Multiple View Geometry in Computer Vision
Richard Hartley and Andrew Zisserman · 2004
Earlier work this paper cites.
“GrabCut”: interactive foreground extraction using iterated graph cuts
Carsten Rother, Vladimir Kolmogorov, and Andrew Blake · 2004
Earlier work this paper cites.
Imagenet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei · 2009
Earlier work this paper cites.
Microsoft COCO: Common objects in context
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick · 2014
Earlier work this paper cites.
The pascal visual object classes challenge: A retrospective
Mark Everingham, S. M. Ali Eslami, Luc Van Gool, Christopher K. I. Williams, John Winn, and Andrew Zisserman · 2015
Earlier work this paper cites.
Category-specific object reconstruction from a single image
Abhishek Kar, Shubham Tulsiani, João Carreira, and Jitendra Malik · 2015
Earlier work this paper cites.
Deep unsupervised learning using nonequilibrium thermodynamics
Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli · 2015
Earlier work this paper cites.
Learning category-specific mesh reconstruction from image collections
Angjoo Kanazawa, Shubham Tulsiani, Alexei A. Efros, and Jitendra Malik · 2018
Earlier work this paper cites.
HoloGAN: Unsupervised learning of 3d representations from natural images
Thu Nguyen-Phuoc, Chuan Li, Lucas Theis, Christian Richardt, and Yong-Liang Yang · 2019
Earlier work this paper cites.
Generative modeling by estimating gradients of the data distribution
Yang Song and Stefano Ermon · 2019
Earlier work this paper cites.
Shape and viewpoints without keypoints
Shubham Goel, Angjoo Kanazawa, and Jitendra Malik · 2020
Earlier work this paper cites.
Denoising diffusion probabilistic models
Jonathan Ho, Ajay Jain, and Pieter Abbeel · 2020
Earlier work this paper cites.
PointRend: Image segmentation as rendering
Alexander Kirillov, Yuxin Wu, Kaiming He, and Ross Girshick · 2020
Cited alongside, same era.
Articulation-aware canonical surface mapping
Nilesh Kulkarni, Abhinav Gupta, David F. Fouhey, and Shubham Tulsiani · 2020
Cited alongside, same era.
Self-supervised single-view 3d reconstruction via semantic consistency
Xueting Li, Sifei Liu, Kihwan Kim, Shalini De Mello, Varun Jampani, Ming-Hsuan Yang, and Jan Kautz · 2020
Cited alongside, same era.
GRAF: Generative radiance fields for 3d-aware image synthesis
Katja Schwarz, Yiyi Liao, Michael Niemeyer, and Andreas Geiger · 2020
Cited alongside, same era.
Unsupervised learning of probably symmetric deformable 3D objects from images in the wild
Shangzhe Wu, Christian Rupprecht, and Andrea Vedaldi · 2020
Cited alongside, same era.
pi-GAN: Periodic implicit generative adversarial networks for 3d-aware image synthesis
Diffusers: State-of-the-art diffusion models
Patrick von Platen, Suraj Patil, Anton Lozhkov, Pedro Cuenca, Nathan Lambert, Kashif Rasul, Mishig Davaadorj, and Thomas Wolf · 2022
Later among the works it cites.
BANMo: Building animatable 3d neural models from many casual videos
Gengshan Yang, Minh Vo, Neverova Natalia, Deva Ramanan, Vedaldi Andrea, and Joo Hanbyul · 2022
Later among the works it cites.
Lassie: Learning articulated shape from sparse image ensemble via 3d part discovery
Chun-Han Yao, Wei-Chih Hung, Michael Rubinstein, Yuanzhen Lee, Varun Jampani, and Ming-Hsuan Yang · 2022
Later among the works it cites.
VectorFusion: Text-to-svg by abstracting pixel-based diffusion models
Ajay Jain, Amber Xie, and Pieter Abbeel · 2023
Closest in time.
Magic3d: High-resolution text-to-3d content creation
Chen-Hsuan Lin, Jun Gao, Luming Tang, Towaki Takikawa, Xiaohui Zeng, Xun Huang, Karsten Kreis, Sanja Fidler, Ming-Yu Liu, and Tsung-Yi Lin · 2023
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Eric Chan, Marco Monteiro, Petr Kellnhofer, Jiajun Wu, and Gordon Wetzstein · 2021
Cited alongside, same era.
To the point: Correspondence-driven monocular 3d category reconstruction
Filippos Kokkinos and Iasonas Kokkinos · 2021
Cited alongside, same era.
Zero-shot text-to-image generation
Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever · 2021
Cited alongside, same era.
Score-based generative modeling through stochastic differential equations
Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole · 2021
Cited alongside, same era.
Efficient geometry-aware 3D generative adversarial networks
Eric R. Chan, Connor Z. Lin, Matthew A. Chan, Koki Nagano, Boxiao Pan, Shalini De Mello, Orazio Gallo, Leonidas Guibas, Jonathan Tremblay, Sameh Khamis, Tero Karras, and Gordon Wetzstein · 2022
Cited alongside, same era.
Photorealistic text-to-image diffusion models with deep language understanding
Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S Sara Mahdavi, Rapha Gontijo Lopes, et al · 2022
Cited alongside, same era.
Stable-dreamfusion: Text-to-3d with stable-diffusion
Jiaxiang Tang · 2022
Cited alongside, same era.
Haohe Liu, Zehua Chen, Yi Yuan, Xinhao Mei, Xubo Liu, Danilo Mandic, Wenwu Wang, and Mark D Plumbley · 2023
Closest in time.
RealFusion: 360 reconstruction of any object from a single image
Luke Melas-Kyriazi, Christian Rupprecht, Iro Laina, and Andrea Vedaldi · 2023
Closest in time.
DreamFusion: Text-to-3d using 2d diffusion
Ben Poole, Ajay Jain, Jonathan T. Barron, and Ben Mildenhall · 2023
Closest in time.
Fake it till you make it: Learning transferable representations from synthetic imagenet clones
Mert Bülent Sarıyıldız, Karteek Alahari, Diane Larlus, and Yannis Kalantidis · 2023
Closest in time.
Stablerep: Synthetic images from text-to-image models make strong visual representation learners
Yonglong Tian, Lijie Fan, Phillip Isola, Huiwen Chang, and Dilip Krishnan · 2023
Closest in time.
MagicPony: Learning articulated 3d animals in the wild
Shangzhe Wu, Ruining Li, Tomas Jakab, Christian Rupprecht, and Andrea Vedaldi · 2023
Closest in time.
Reconstructing animatable categories from videos
Gengshan Yang, Chaoyang Wang, N. Dinesh Reddy, and Deva Ramanan · 2023
Closest in time.
Hi-lassie: High-fidelity articulated shape and skeleton discovery from sparse image ensemble
Chun-Han Yao, Wei-Chih Hung, Yuanzhen Li, Michael Rubinstein, Ming-Hsuan Yang, and Varun Jampani · 2023
Closest in time.