Evaluating Zero-Shot GPT-4V Performance on 3D Visual Question Answering Benchmarks

Scannet: Richly-annotated 3d reconstructions of indoor scenes

Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, and Matthias Nießner · 2017

Earlier work this paper cites.

Embodied question answering

Abhishek Das, Samyak Datta, Georgia Gkioxari, Stefan Lee, Devi Parikh, and Dhruv Batra · 2018

Earlier work this paper cites.

Tvqa: Localized, compositional video question answering

Original

Jie Lei, Licheng Yu, Mohit Bansal, and Tamara L Berg · 2018

Earlier work this paper cites.

Embodied question answering in photorealistic environments with point cloud perception

Erik Wijmans, Samyak Datta, Oleksandr Maksymets, Abhishek Das, Georgia Gkioxari, Stefan Lee, Irfan Essa, Devi Parikh, and Dhruv Batra · 2019

Earlier work this paper cites.

Multi-target embodied question answering

Licheng Yu, Xinlei Chen, Georgia Gkioxari, Mohit Bansal, Tamara L Berg, and Dhruv Batra · 2019

Earlier work this paper cites.

Referit3d: Neural listeners for fine-grained 3d object identification in real-world scenes

Panos Achlioptas, Ahmed Abdelreheem, Fei Xia, Mohamed Elhoseiny, and Leonidas Guibas · 2020

Earlier work this paper cites.

Star: A benchmark for situated reasoning in real-world videos

Bo Wu, Shoubin Yu, Zhenfang Chen, Joshua B Tenenbaum, and Chuang Gan · 2021

Earlier work this paper cites.

Scanqa: 3d question answering for spatial scene understanding

Daichi Azuma, Taiki Miyanishi, Shuhei Kurita, and Motoaki Kawanabe · 2022

Cited alongside, same era.

3dvqa: Visual question answering for 3d environments

Yasaman Etesam, Leon Kochiev, and Angel X. Chang · 2022

Cited alongside, same era.

Detecting twenty-thousand classes using image-level supervision, 2022

Xingyi Zhou, Rohit Girdhar, Armand Joulin, Philipp Krähenbühl, and Ishan Misra · 2022

Cited alongside, same era.

Conceptgraphs: Open-vocabulary 3d scene graphs for perception and planning

Original

Qiao Gu, Alihusein Kuwajerwala, Sacha Morin, Krishna Murthy Jatavallabhula, Bipasha Sen, Aditya Agarwal, Corban Rivera, William Paul, Kirsty Ellis, Rama Chellappa, et al · 2023

Cited alongside, same era.

Groundnlq@ ego4d natural language queries challenge 2023

Original

Zhijian Hou, Lei Ji, Difei Gao, Wanjun Zhong, Kun Yan, Chao Li, Wing-Kwong Chan, Chong-Wah Ngo, Nan Duan, and Mike Zheng Shou · 2023

Self-consistency improves chain of thought reasoning in language models, 2023

Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou · 2023

Later among the works it cites.

https://learn.microsoft.com/en-us/azure/ai-services/openai/quotas-limits

Microsoft: Azure OpenAI Service quotas and limits · 2024

Closest in time.

https://github.com/ScanNet/ScanNet

GitHub Repo: ScanNet · 2024

Closest in time.

https://ai.meta.com/blog/openeqa-embodied-question-answering-robotics-ar-glasses/

Meta blogpost – OpenEQA: From word models to world models · 2024

Closest in time.

Geckopt: Llm system efficiency via intent-based tool selection, 2024

Michael Fore, Simranjit Singh, and Dimitrios Stamoulis · 2024

Closest in time.

Openeqa: Embodied question answering in the era of foundation models

Arjun Majumdar, Anurag Ajay, Xiaohan Zhang, Pranav Putta, Sriram Yenamandra, Mikael Henaff, Sneha Silwal, Paul Mcvay, Oleksandr Maksymets, Sergio Arnaud, Karmesh Yadav, Qiyang Li, Ben Newman, Mohit Sharma, Vincent Berges, Shiqi Zhang, Pulkit Agrawal, Yonatan Bisk, Dhruv Batra, Mrinal Kalakrishnan, Franziska Meier, Chris Paxton, Sasha Sax, and Aravind Rajeswaran · 2024