Fetching the paper…
Reading the bibliography…
We introduce OpenShape, a method for learning multi-modal joint representations of text, image, and point clouds.
Shapenet: An information-rich 3d model repository
Angel X Chang, Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, et al · 2015
Earlier work this paper cites.
Voxnet: A 3d convolutional neural network for real-time object recognition
Daniel Maturana and Sebastian Scherer · 2015
Earlier work this paper cites.
3d shapenets: A deep representation for volumetric shapes
Zhirong Wu, Shuran Song, Aditya Khosla, Fisher Yu, Linguang Zhang, Xiaoou Tang, and Jianxiong Xiao · 2015
Earlier work this paper cites.
Pointnet: Deep learning on point sets for 3d classification and segmentation
Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas · 2017
Earlier work this paper cites.
Pointnet++: Deep hierarchical feature learning on point sets in a metric space
Charles Ruizhongtai Qi, Li Yi, Hao Su, and Leonidas J Guibas · 2017
Earlier work this paper cites.
Learning representations and generative models for 3d point clouds
Panos Achlioptas, Olga Diamanti, Ioannis Mitliagkas, and Leonidas Guibas · 2018
Earlier work this paper cites.
Ppf-foldnet: Unsupervised learning of rotation invariant 3d local descriptors
Haowen Deng, Tolga Birdal, and Slobodan Ilic · 2018
Earlier work this paper cites.
4d spatio-temporal convnets: Minkowski convolutional neural networks
Christopher Choy, JunYoung Gwak, and Silvio Savarese · 2019
Earlier work this paper cites.
Lvis: A dataset for large vocabulary instance segmentation
Agrim Gupta, Piotr Dollar, and Ross Girshick · 2019
Earlier work this paper cites.
Self-supervised deep learning on point clouds by reconstructing space
Jonathan Sauder and Bjarne Sievers · 2019
Earlier work this paper cites.
Revisiting point cloud classification: A new benchmark dataset and classification model on real-world data
Mikaela Angelina Uy, Quang-Hieu Pham, Binh-Son Hua, Thanh Nguyen, and Sai-Kit Yeung · 2019
Earlier work this paper cites.
Dynamic graph cnn for learning on point clouds
Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E Sarma, Michael M Bronstein, and Justin M Solomon · 2019
Earlier work this paper cites.
Hard negative mixing for contrastive learning
Yannis Kalantidis, Mert Bulent Sariyildiz, Noe Pion, Philippe Weinzaepfel, and Diane Larlus · 2020
Earlier work this paper cites.
Self-supervised learning of point clouds via orientation estimation
Omid Poursaeed, Tianxing Jiang, Han Qiao, Nayun Xu, and Vladimir G Kim · 2020
Earlier work this paper cites.
Global-local bidirectional reasoning for unsupervised representation learning of 3d point clouds
Yongming Rao, Jiwen Lu, and Jie Zhou · 2020
Earlier work this paper cites.
Contrastive learning with hard negative samples
Joshua Robinson, Ching-Yao Chuang, Suvrit Sra, and Stefanie Jegelka · 2020
Earlier work this paper cites.
Info3d: Representation learning on 3d objects using mutual information maximization and contrastive learning
Aditya Sanghi · 2020
Earlier work this paper cites.
Self-supervised few-shot learning on point clouds
Charu Sharma and Manohar Kaul · 2020
Earlier work this paper cites.
Self-supervised learning of local features in 3d point clouds
Ali Thabet, Humam Alwassel, and Bernard Ghanem · 2020
Earlier work this paper cites.
Pointcontrast: Unsupervised pre-training for 3d point cloud understanding
Saining Xie, Jiatao Gu, Demi Guo, Charles R Qi, Leonidas Guibas, and Or Litany · 2020
Earlier work this paper cites.
Self-supervised learning for domain adaptation on point clouds
Idan Achituve, Haggai Maron, and Gal Chechik · 2021
Earlier work this paper cites.
Self-supervised learning on 3d point clouds by learning discrete generative models
Benjamin Eckart, Wentao Yuan, Chao Liu, and Jan Kautz · 2021
Earlier work this paper cites.
3d-future: 3d furniture shape with texture
Huan Fu, Rongfei Jia, Lin Gao, Mingming Gong, Binqiang Zhao, Steve Maybank, and Dacheng Tao · 2021
Earlier work this paper cites.
Openclip, July 2021
Gabriel Ilharco, Mitchell Wortsman, Ross Wightman, Cade Gordon, Nicholas Carlini, Rohan Taori, Achal Dave, Vaishaal Shankar, Hongseok Namkoong, John Miller, Hannaneh Hajishirzi, Ali Farhadi, and Ludwig Schmidt · 2021
Earlier work this paper cites.
Clipmatrix: Text-controlled creation of 3d textured meshes
Nikolay Jetchev · 2021
Earlier work this paper cites.
Scaling up visual and vision-language representation learning with noisy text supervision
Chao Jia, Yinfei Yang, Ye Xia, Yi-Ting Chen, Zarana Parekh, Hieu Pham, Quoc Le, Yun-Hsuan Sung, Zhen Li, and Tom Duerig · 2021
Earlier work this paper cites.
Clipcap: Clip prefix for image captioning
Ron Mokady, Amir Hertz, and Amit H Bermano · 2021
Earlier work this paper cites.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021
Earlier work this paper cites.
Point cloud pre-training by mixing and disentangling
Chao Sun, Zhedong Zheng, Xiaohan Wang, Mingliang Xu, and Yi Yang · 2021
Cited alongside, same era.
Unsupervised point cloud pre-training via occlusion completion
Hanchen Wang, Qi Liu, Xiangyu Yue, Joan Lasenby, and Matt J Kusner · 2021
Cited alongside, same era.
Jean-Baptiste Weibel, Timothy Patten, and Markus Vincze · 2021
Cited alongside, same era.
Self-supervised pretraining of 3d features on any point-cloud
Zaiwei Zhang, Rohit Girdhar, Armand Joulin, and Ishan Misra · 2021
Cited alongside, same era.
Flamingo: a visual language model for few-shot learning
Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katie Millican, Malcolm Reynolds, et al · 2022
Cited alongside, same era.
Hierarchical text-conditional image generation with clip latents
Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen · 2022
Later among the works it cites.
High-resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2022
Later among the works it cites.
Language-grounded indoor 3d semantic segmentation in the wild
David Rozenberszki, Or Litany, and Angela Dai · 2022
Later among the works it cites.
Photorealistic text-to-image diffusion models with deep language understanding
Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S Sara Mahdavi, Rapha Gontijo Lopes, et al · 2022
Later among the works it cites.
Clip-forge: Towards zero-shot text-to-shape generation
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Clipface: Text-guided editing of textured 3d morphable models
Shivangi Aneja, Justus Thies, Angela Dai, and Matthias Nießner · 2022
Cited alongside, same era.
Clip retrieval: Easily compute clip embeddings and build a clip retrieval system with them
Romain Beaumont · 2022
Cited alongside, same era.
Abo: Dataset and benchmarks for real-world 3d object understanding
Jasmine Collins, Shubham Goel, Kenan Deng, Achleshwar Luthra, Leon Xu, Erhan Gundogdu, Xi Zhang, Tomas F Yago Vicente, Thomas Dideriksen, Himanshu Arora, et al · 2022
Cited alongside, same era.
Objaverse: A universe of annotated 3d objects
Matt Deitke, Dustin Schwenk, Jordi Salvador, Luca Weihs, Oscar Michel, Eli VanderBilt, Ludwig Schmidt, Kiana Ehsani, Aniruddha Kembhavi, and Ali Farhadi · 2022
Cited alongside, same era.
Language-driven open-vocabulary 3d scene understanding
Runyu Ding, Jihan Yang, Chuhui Xue, Wenqing Zhang, Song Bai, and Xiaojuan Qi · 2022
Cited alongside, same era.
Semantic abstraction: Open-world 3d scene understanding from 2d vision-language models
Huy Ha and Shuran Song · 2022
Cited alongside, same era.
Lidarclip or: How i learned to talk to point clouds
Georg Hess, Adam Tonderski, Christoffer Petersson, Lennart Svensson, and Kalle Åström · 2022
Cited alongside, same era.
Aditya Sanghi, Hang Chu, Joseph G Lambourne, Ye Wang, Chin-Yi Cheng, Marco Fumero, and Kamal Rahimi Malekshan · 2022
Later among the works it cites.
Laion-5b: An open large-scale dataset for training next generation image-text models
Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Wortsman, et al · 2022
Later among the works it cites.
Understanding and fixing the modality gap in vision-language models
Vishaal Udandarao · 2022
Later among the works it cites.
Dream3d: Zero-shot text-to-3d synthesis using 3d shape prior and text-to-image diffusion models
Jiale Xu, Xintao Wang, Weihao Cheng, Yan-Pei Cao, Ying Shan, Xiaohu Qie, and Shenghua Gao · 2022
Later among the works it cites.
Ulip: Learning unified representation of language, image and point cloud for 3d understanding
Le Xue, Mingfei Gao, Chen Xing, Roberto Martín-Martín, Jiajun Wu, Caiming Xiong, Ran Xu, Juan Carlos Niebles, and Silvio Savarese · 2022
Later among the works it cites.
Point-bert: Pre-training 3d point cloud transformers with masked point modeling
Xumin Yu, Lulu Tang, Yongming Rao, Tiejun Huang, Jie Zhou, and Jiwen Lu · 2022
Later among the works it cites.
Point-bert: Pre-training 3d point cloud transformers with masked point modeling
Xumin Yu, Lulu Tang, Yongming Rao, Tiejun Huang, Jie Zhou, and Jiwen Lu · 2022
Later among the works it cites.
Glipv2: Unifying localization and vision-language understanding
Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, and Jianfeng Gao · 2022
Later among the works it cites.
Pointclip: Point cloud understanding by clip
Renrui Zhang, Ziyu Guo, Wei Zhang, Kunchang Li, Xupeng Miao, Bin Cui, Yu Qiao, Peng Gao, and Hongsheng Li · 2022
Later among the works it cites.
Pointclip v2: Adapting clip for powerful 3d open-world learning
Xiangyang Zhu, Renrui Zhang, Bowei He, Ziyao Zeng, Shanghang Zhang, and Peng Gao · 2022
Later among the works it cites.
Satr: Zero-shot semantic segmentation of 3d shapes
Ahmed Abdelreheem, Ivan Skorokhodov, Maks Ovsjanikov, and Peter Wonka · 2023
Closest in time.
Text and image guided 3d avatar generation and manipulation
Zehranaz Canfes, M Furkan Atasoy, Alara Dirik, and Pinar Yanardag · 2023
Closest in time.
Clip2scene: Towards label-efficient 3d scene understanding by clip
Runnan Chen, Youquan Liu, Lingdong Kong, Xinge Zhu, Yuexin Ma, Yikang Li, Yuenan Hou, Yu Qiao, and Wenping Wang · 2023
Closest in time.
Clip goes 3d: Leveraging prompt tuning for language grounded 3d recognition
Deepti Hegde, Jeya Maria Jose Valanarasu, and Vishal M Patel · 2023
Closest in time.
Masked autoencoder for self-supervised pre-training on lidar point clouds
Georg Hess, Johan Jaxing, Elias Svensson, David Hagerman, Christoffer Petersson, and Lennart Svensson · 2023
Closest in time.
Joint representation learning for text and 3d point cloud
Rui Huang, Xuran Pan, Henry Zheng, Haojun Jiang, Zhifeng Xie, Shiji Song, and Gao Huang · 2023
Closest in time.
Conceptfusion: Open-set multimodal 3d mapping
Krishna Murthy Jatavallabhula, Alihusein Kuwajerwala, Qiao Gu, Mohd Omama, Tao Chen, Shuang Li, Ganesh Iyer, Soroush Saryazdi, Nikhil Keetha, Ayush Tewari, et al · 2023
Closest in time.
Lerf: Language embedded radiance fields
Justin Kerr, Chung Min Kim, Ken Goldberg, Angjoo Kanazawa, and Matthew Tancik · 2023
Closest in time.
Open-vocabulary point-cloud object detection without 3d annotation
Yuheng Lu, Chenfeng Xu, Xiaobao Wei, Xiaodong Xie, Masayoshi Tomizuka, Kurt Keutzer, and Shanghang Zhang · 2023
Closest in time.
Gpt-4 technical report, 2023
OpenAI · 2023
Closest in time.
Contrast with reconstruct: Contrastive 3d representation learning guided by generative pretraining
Zekun Qi, Runpei Dong, Guofan Fan, Zheng Ge, Xiangyu Zhang, Kaisheng Ma, and Li Yi · 2023
Closest in time.
Regionplc: Regional point-language contrastive learning for open-world 3d scene understanding
Jihan Yang, Runyu Ding, Zhe Wang, and Xiaojuan Qi · 2023
Closest in time.
Clipˆ 2: Contrastive language-image-point pretraining from real-world point cloud data
Yihan Zeng, Chenhan Jiang, Jiageng Mao, Jianhua Han, Chaoqiang Ye, Qingqiu Huang, Dit-Yan Yeung, Zhen Yang, Xiaodan Liang, and Hang Xu · 2023
Closest in time.
Clip-fo3d: Learning free open-world 3d scene representations from 2d dense clip
Junbo Zhang, Runpei Dong, and Kaisheng Ma · 2023
Closest in time.