Exploring Visual Culture Awareness in GPT-4V: A Comprehensive Probing

Understand

Pretrained large Vision-Language models have drawn considerable interest in recent years due to their remarkable performance.

• Despite considerable efforts to assess these models from diverse perspectives, the extent of visual cultural awareness in the state-of-the-art GPT-4V model remains unexplored.
• To tackle this gap, we extensively probed GPT-4V using the MaRVL benchmark dataset, aiming to investigate its capabilities and limitations in visual understanding with a focus on cultural aspects.
• Specifically, we introduced three visual related tasks, i.e.