Mixture of Experts for Biomedical Question Answering

Understand

Biomedical Question Answering (BQA) has attracted increasing attention in recent years due to its promising application prospect.

• It is a challenging task because the biomedical questions are professional and usually vary widely.
• Existing question answering methods answer all questions with a homogeneous model, leading to various types of questions competing for the shared parameters, which will confuse the model decision for each single type of questions.
• In this paper, in order to alleviate the parameter competition problem, we propose a Mixture-of-Expert (MoE) based question answering method called MoEBQA that decouples the computation for different types of questions by sparse routing.