LPF: A Language-Prior Feedback Objective Function for De-biased Visual Question Answering

Understand

Most existing Visual Question Answering (VQA) systems tend to overly rely on language bias and hence fail to reason from the visual clue.

• To address this issue, we propose a novel Language-Prior Feedback (LPF) objective function, to re-balance the proportion of each answer's loss value in the total VQA loss.
• The LPF firstly calculates a modulating factor to determine the language bias using a question-only branch.
• Then, the LPF assigns a self-adaptive weight to each training sample in the training process.