What Do You See? Enhancing Zero-Shot Image Classification with Multimodal Large Language Models

Understand

Large language models (LLMs) have been effectively used for many computer vision tasks, including image classification.

• In this paper, we present a simple yet effective approach for zero-shot image classification using multimodal LLMs.
• Using multimodal LLMs, we generate comprehensive textual representations from input images.
• These textual representations are then utilized to generate fixed-dimensional features in a cross-modal embedding space.