Align-KD: Distilling Cross-Modal Alignment Knowledge for Mobile Vision-Language Model Enhancement

Understand

Vision-Language Models (VLMs) bring powerful understanding and reasoning capabilities to multimodal tasks.

• Meanwhile, the great need for capable aritificial intelligence on mobile devices also arises, such as the AI assistant software.
• Some efforts try to migrate VLMs to edge devices to expand their application scope.
• Simplifying the model structure is a common method, but as the model shrinks, the trade-off between performance and size becomes more and more difficult.