FTII-Bench: A Comprehensive Multimodal Benchmark for Flow Text with Image Insertion

Understand

Benefiting from the revolutionary advances in large language models (LLMs) and foundational vision models, large vision-language models (LVLMs) have also made significant progress.

• However, current benchmarks focus on tasks that evaluating only a single aspect of LVLM capabilities (e.g., recognition, detection, understanding).
• These tasks fail to fully demonstrate LVLMs' potential in complex application scenarios.
• To comprehensively assess the performance of existing LVLMs, we propose a more challenging task called the Flow Text with Image Insertion task (FTII).