Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps

Understand

A multi-hop question answering (QA) dataset aims to test reasoning and inference skills by requiring a model to read multiple paragraphs to answer a given question.

• However, current datasets do not provide a complete explanation for the reasoning process from the question to the answer.
• Further, previous studies revealed that many examples in existing multi-hop datasets do not require multi-hop reasoning to answer a question.
• In this study, we present a new multi-hop QA dataset, called 2WikiMultiHopQA, which uses structured and unstructured data.