MPMQA: Multimodal Question Answering on Product Manuals

Understand

Visual contents, such as illustrations and images, play a big role in product manual understanding.

• Existing Product Manual Question Answering (PMQA) datasets tend to ignore visual contents and only retain textual parts.
• In this work, to emphasize the importance of multimodal contents, we propose a Multimodal Product Manual Question Answering (MPMQA) task.
• For each question, MPMQA requires the model not only to process multimodal contents but also to provide multimodal answers.