Lost in Translation: When GPT-4V(ision) Can't See Eye to Eye with Text. A Vision-Language-Consistency Analysis of VLLMs and Beyond

Dimensionality of compound-coordinate bilingualism

Leon A Jakobovits. 1968 · 1968

Earlier work this paper cites.

Three types of bilingualism

Maria Rosaria D’Acierno. 1990 · 1990

Earlier work this paper cites.

Lexical representation of cognates and noncognates in compound bilinguals

Annette MB De Groot and Gerard LJ Nas. 1991 · 1991

Earlier work this paper cites.

Question answering with subgraph embeddings

Antoine Bordes, Sumit Chopra, and Jason Weston. 2014 · 2014

Earlier work this paper cites.

An investigation through different types of bilinguals and bilingualism

Hamzeh Moradi. 2014 · 2014

Earlier work this paper cites.

CommonsenseQA: A question answering challenge targeting commonsense knowledge

Alon Talmor, Jonathan Herzig, Nicholas Lourie, and Jonathan Berant. 2019 · 2019

Cited alongside, same era.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. 2021 · 2021

Cited alongside, same era.

Learning transferable visual models from natural language supervision

Original

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021 · 2021

Cited alongside, same era.

Revive: Regional visual representation matters in knowledge-based visual question answering

Original

Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, and Lu Yuan. 2022 · 2022

Cited alongside, same era.

Towards end-to-end embodied decision making via multi-modal large language model: Explorations with gpt4-vision and beyond

Original

Liang Chen, Yichi Zhang, Shuhuai Ren, Haozhe Zhao, Zefan Cai, Yuchi Wang, Peiyi Wang, Tianyu Liu, and Baobao Chang. 2023 · 2023

Cited alongside, same era.

Vision-language models for vision tasks: A survey

Original

Jingyi Zhang, Jiaxing Huang, Sheng Jin, and Shijian Lu. 2023a

Cited in the paper.

Don’t trust gpt when your question is not in english

Original

Xiang Zhang, Senyu Li, Bradley Hauer, Ning Shi, and Grzegorz Kondrak. 2023b

Cited in the paper.

Bridging the gap between babelnet and hownet: Unsupervised sense alignment and sememe prediction

Xiang Zhang, Ning Shi, Bradley Hauer, and Grzegorz Kondrak. 2023c

Cited in the paper.

Palm-e: An embodied multimodal language model

Original

Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duckworth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint, Klaus Greff, Andy Zeng, Igor Mordatch, and Pete Florence. 2023 · 2023

Closest in time.

Promptcap: Prompt-guided task-aware image captioning

Original

Yushi Hu, Hang Hua, Zhengyuan Yang, Weijia Shi, Noah A Smith, and Jiebo Luo. 2023 · 2023

Closest in time.

Chatgpt for shaping the future of dentistry: the potential of multi-modal large language model

Hanyao Huang, Ou Zheng, Dongdong Wang, Jiayi Yin, Zijin Wang, Shengxuan Ding, Heng Yin, Chuan Xu, Renjie Yang, Qian Zheng, et al. 2023 · 2023

Closest in time.

The dawn of lmms: Preliminary explorations with gpt-4v (ision)

Original

Zhengyuan Yang, Linjie Li, Kevin Lin, Jianfeng Wang, Chung-Ching Lin, Zicheng Liu, and Lijuan Wang. 2023 · 2023

Closest in time.