MMIDR: Teaching Large Language Model to Interpret Multimodal Misinformation via Knowledge Distillation

Understand

Automatic detection of multimodal misinformation has gained a widespread attention recently.

• However, the potential of powerful Large Language Models (LLMs) for multimodal misinformation detection remains underexplored.
• Besides, how to teach LLMs to interpret multimodal misinformation in cost-effective and accessible way is still an open question.
• To address that, we propose MMIDR, a framework designed to teach LLMs in providing fluent and high-quality textual explanations for their decision-making process of multimodal misinformation.