Question Relevance in Visual Question Answering

Understand

Free-form and open-ended Visual Question Answering systems solve the problem of providing an accurate natural language answer to a question pertaining to an image.

• Current VQA systems do not evaluate if the posed question is relevant to the input image and hence provide nonsensical answers when posed with irrelevant questions to an image.
• In this paper, we solve the problem of identifying the relevance of the posed question to an image.
• We address the problem as two sub-problems.