HueManity: Probing Fine-Grained Visual Perception in MLLMs

Understand

Recent Multimodal Large Language Models (MLLMs) demonstrate strong high-level visual reasoning on tasks such as visual question answering and image captioning.

• Yet existing benchmarks largely overlook their ability to capture fine-grained perceptual details.
• As MLLMs are increasingly deployed in safety and reliability critical settings, perceptual acuity becomes essential.
• We present HueManity, a scalable automated benchmark for assessing fine-grained visual perception in MLLMs.