In-BoXBART: Get Instructions into Biomedical Multi-Task Learning

Understand

Single-task models have proven pivotal in solving specific tasks; however, they have limitations in real-world applications where multi-tasking is necessary and domain shifts are exhibited.

• Recently, instructional prompts have shown significant improvement towards multi-task generalization; however, the effect of instructional prompts and Multi-Task Learning (MTL) has not been systematically studied in the biomedical domain.
• Motivated by this, this paper explores the impact of instructional prompts for biomedical MTL.
• We introduce the BoX, a collection of 32 instruction tasks for Biomedical NLP across (X) various categories.