More Text, Less Point: Towards 3D Data-Efficient Point-Language Understanding

Sentence-bert: Sentence embeddings using siamese bert-networks

Original

Reimers, N.; and Gurevych, I. 2019 · 1908

Earlier work this paper cites.

3d shapenets: A deep representation for volumetric shapes

Wu, Z.; Song, S.; Khosla, A.; Yu, F.; Zhang, L.; Tang, X.; and Xiao, J. 2015 · 1920

Earlier work this paper cites.

An image is worth 16x16 words: Transformers for image recognition at scale

Original

Dosovitskiy, A.; Beyer, L.; Kolesnikov, A.; Weissenborn, D.; Zhai, X.; Unterthiner, T.; Dehghani, M.; Minderer, M.; Heigold, G.; Gelly, S.; et al. 2020 · 2010

Earlier work this paper cites.

Generating wikipedia by summarizing long sequences

Original

Liu, P. J.; Saleh, M.; Pot, E.; Goodrich, B.; Sepassi, R.; Kaiser, L.; and Shazeer, N. 2018 · 2018

Earlier work this paper cites.

Simcse: Simple contrastive learning of sentence embeddings

Original

Gao, T.; Yao, X.; and Chen, D. 2021 · 2021

Earlier work this paper cites.

Lora: Low-rank adaptation of large language models

Original

Hu, E. J.; Shen, Y.; Wallis, P.; Allen-Zhu, Z.; Li, Y.; Wang, S.; Wang, L.; and Chen, W. 2021 · 2021

Earlier work this paper cites.

Learning transferable visual models from natural language supervision

Radford, A.; Kim, J. W.; Hallacy, C.; Ramesh, A.; Goh, G.; Agarwal, S.; Sastry, G.; Askell, A.; Mishkin, P.; Clark, J.; et al. 2021 · 2021

Earlier work this paper cites.

Laion-5b: An open large-scale dataset for training next generation image-text models

Schuhmann, C.; Beaumont, R.; Vencu, R.; Gordon, C.; Wightman, R.; Cherti, M.; Coombes, T.; Katta, A.; Mullis, C.; Wortsman, M.; et al. 2022 · 2022

Earlier work this paper cites.

Self-instruct: Aligning language models with self-generated instructions

Original

Wang, Y.; Kordi, Y.; Mishra, S.; Liu, A.; Smith, N. A.; Khashabi, D.; and Hajishirzi, H. 2022 · 2022

Earlier work this paper cites.

Rt-2: Vision-language-action models transfer web knowledge to robotic control

Original

Brohan, A.; Brown, N.; Carbajal, J.; Chebotar, Y.; Chen, X.; Choromanski, K.; Ding, T.; Driess, D.; Dubey, A.; Finn, C.; et al. 2023 · 2023

Earlier work this paper cites.

Objaverse: A universe of annotated 3d objects

Deitke, M.; Schwenk, D.; Salvador, J.; Weihs, L.; Michel, O.; VanderBilt, E.; Schmidt, L.; Ehsani, K.; Kembhavi, A.; and Farhadi, A. 2023 · 2023

Earlier work this paper cites.

Palm-e: An embodied multimodal language model

Original

Driess, D.; Xia, F.; Sajjadi, M. S.; Lynch, C.; Chowdhery, A.; Ichter, B.; Wahid, A.; Tompson, J.; Vuong, Q.; Yu, T.; et al. 2023 · 2023

Cited alongside, same era.

Point-bind & point-llm: Aligning point cloud with multi-modality for 3d understanding, generation, and instruction following

Original

Guo, Z.; Zhang, R.; Zhu, X.; Tang, Y.; Ma, X.; Han, J.; Chen, K.; Gao, P.; Li, X.; Li, H.; et al. 2023 · 2023

Cited alongside, same era.

3d-llm: Injecting the 3d world into large language models

Hong, Y.; Zhen, H.; Chen, P.; Zheng, S.; Du, Y.; Chen, Z.; and Gan, C. 2023 · 2023

Cited alongside, same era.

Clip2point: Transfer clip to point cloud classification with image-depth pre-training

Huang, T.; Dong, B.; Yang, Y.; Huang, X.; Lau, R. W.; Ouyang, W.; and Zuo, W. 2023 · 2023

Cited alongside, same era.

Gpt-4 technical report. arxiv 2303.08774

OpenAI, R. 2023 · 2023

Cited alongside, same era.

Phi-3 technical report: A highly capable language model locally on your phone

Original

Abdin, M.; Jacobs, S. A.; Awan, A. A.; Aneja, J.; Awadallah, A.; Awadalla, H.; Bach, N.; Bahree, A.; Bakhtiari, A.; Behl, H.; et al. 2024 · 2024

Closest in time.

Instructblip: Towards general-purpose vision-language models with instruction tuning

Dai, W.; Li, J.; Li, D.; Tiong, A. M. H.; Zhao, J.; Wang, W.; Li, B.; Fung, P. N.; and Hoi, S. 2024 · 2024

Closest in time.

The llama 3 herd of models

Original

Dubey, A.; Jauhri, A.; Pandey, A.; Kadian, A.; Al-Dahle, A.; Letman, A.; Mathur, A.; Schelten, A.; Yang, A.; Fan, A.; et al. 2024 · 2024

Closest in time.

Drive like a human: Rethinking autonomous driving with large language models

Fu, D.; Li, X.; Wen, L.; Dou, M.; Cai, P.; Shi, B.; and Qiao, Y. 2024 · 2024

Closest in time.

Sculpting Holistic 3D Representation in Contrastive Language-Image-3D Pre-training

Gao, Y.; Wang, Z.; Zheng, W.-S.; Xie, C.; and Zhou, Y. 2024 · 2024