Can Large Multimodal Models Uncover Deep Semantics Behind Images?

Understand

Understanding the deep semantics of images is essential in the era dominated by social media.

• However, current research works primarily on the superficial description of images, revealing a notable deficiency in the systematic investigation of the inherent deep semantics.
• In this work, we introduce DEEPEVAL, a comprehensive benchmark to assess Large Multimodal Models' (LMMs) capacities of visual deep semantics.
• DEEPEVAL includes human-annotated dataset and three progressive subtasks: fine-grained description selection, in-depth title matching, and deep semantics understanding.