2019

Compositional Questions Do Not Necessitate Multi-hop Reasoning

Min, Sewon, Wallace, Eric, Singh, Sameer et al.

Understand

Multi-hop reading comprehension (RC) questions are challenging because they require reading and reasoning over multiple paragraphs.

  • We argue that it can be difficult to construct large multi-hop RC datasets.
  • For example, even highly compositional questions can be answered with a single hop if they target specific entity types, or the facts needed to answer them are redundant.
  • Our analysis is centered on HotpotQA, where we show that single-hop reasoning can solve much more of the dataset than previously thought.

Built on

  • Semantic parsing on freebase from question-answer pairs

    Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. 2013 · 2013

    Earlier work this paper cites.

  • Teaching machines to read and comprehend

    Karl Moritz Hermann, Tomas Kocisky, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, and Phil Blunsom. 2015 · 2015

    Earlier work this paper cites.

  • Adam: A method for stochastic optimization

    Diederik P Kingma and Jimmy Ba. 2015 · 2015

    Earlier work this paper cites.

  • SQuAD: 100,000+ questions for machine comprehension of text

    Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016 · 2016

    Earlier work this paper cites.

  • Reading wikipedia to answer open-domain questions

    Danqi Chen, Adam Fisch, Jason Weston, and Antoine Bordes. 2017 · 2017

    Earlier work this paper cites.

  • TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension

    Mandar Joshi, Eunsol Choi, Daniel S Weld, and Luke Zettlemoyer. 2017 · 2017

    Earlier work this paper cites.

Similar

  • Automatic differentiation in PyTorch

    Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017 · 2017

    Cited alongside, same era.

  • Bidirectional attention flow for machine comprehension

    Minjoon Seo, Aniruddha Kembhavi, Ali Farhadi, and Hannaneh Hajishirzi. 2017 · 2017

    Cited alongside, same era.

  • Constructing Datasets for Multi-hop Reading Comprehension Across Documents

    Johannes Welbl, Pontus Stenetorp, and Sebastian Riedel. 2017 · 2017

    Cited alongside, same era.

  • Simple and effective multi-paragraph reading comprehension

    Christopher Clark and Matt Gardner. 2018 · 2018

    Cited alongside, same era.

  • BERT: Pre-training of deep bidirectional transformers for language understanding

    Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018

    Cited alongside, same era.

  • The NarrativeQA reading comprehension challenge

    Tomáš Kočiskỳ, Jonathan Schwarz, Phil Blunsom, Chris Dyer, Karl Moritz Hermann, Gábor Melis, and Edward Grefenstette. 2018 · 2018

    Cited alongside, same era.

Then

  • What makes reading comprehension questions easier?

    Saku Sugawara, Kentaro fInui, Satoshi Sekine, and Akiko Aizawa. 2018 · 2018

    Later among the works it cites.

  • The web as a knowledge-base for answering complex questions

    Alon Talmor and Jonathan Berant. 2018 · 2018

    Later among the works it cites.

  • DCN+: Mixed objective and deep residual coattention for question answering

    Caiming Xiong, Victor Zhong, and Richard Socher. 2018 · 2018

    Later among the works it cites.

  • HotpotQA: A dataset for diverse, explainable multi-hop question answering

    Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William W Cohen, Ruslan Salakhutdinov, and Christopher D Manning. 2018 · 2018

    Later among the works it cites.

  • Qanet: Combining local convolution with global self-attention for reading comprehension

    Adams Wei Yu, David Dohan, Minh-Thang Luong, Rui Zhao, Kai Chen, Mohammad Norouzi, and Quoc V. Le. 2018 · 2018

    Later among the works it cites.

  • Understanding dataset design choices for multi-hop reasoning

    Jifan Chen and Greg Durrett. 2019 · 2019

    Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…