Improved Synthetic Training for Reading Comprehension

Understand

Automatically generated synthetic training examples have been shown to improve performance in machine reading comprehension (MRC).

• Compared to human annotated gold standard data, synthetic training data has unique properties, such as high availability at the possible expense of quality.
• In view of such differences, in this paper, we explore novel applications of synthetic examples to MRC.
• Our proposed pre-training and knowledge distillation strategies show significant improvements over existing methods.