Efficient Multimodal Large Language Models: A Survey

Understand

In the past year, Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance in tasks such as visual question answering, visual understanding and reasoning.

• However, the extensive model size and high training and inference costs have hindered the widespread application of MLLMs in academia and industry.
• Thus, studying efficient and lightweight MLLMs has enormous potential, especially in edge computing scenarios.
• In this survey, we provide a comprehensive and systematic review of the current state of efficient MLLMs.