Understand
We introduce the first open-domain dataset, called QuaRTz, for reasoning about textual qualitative relationships.
- QuaRTz contains general qualitative statements, e.g., "A sunscreen with a higher SPF protects the skin longer.", twinned with 3864 crowdsourced situated questions, e.g., "Billy is wearing sunscreen with a lower SPF than Lucy.
- Who will be best protected from the sun?", plus annotations of the properties being compared.
- Unlike previous datasets, the general knowledge is textual and not tied to a fixed set of relationships, and tests a system's ability to comprehend and apply textual qualitative knowledge in a novel setting.
Built on
Qualitative process theory
Kenneth D. Forbus. 1984 · 1984
Earlier work this paper cites.
Semantic parsing on Freebase from question-answer pairs
Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. 2013 · 2013
Earlier work this paper cites.
Readings in qualitative reasoning about physical systems
Daniel S Weld and Johan De Kleer. 2013 · 2013
Earlier work this paper cites.
Using narrative function to extract qualitative information from natural language texts
Clifton James McFate, Kenneth D Forbus, and Thomas R Hinrichs. 2014 · 2014
Earlier work this paper cites.
Scaling up linguistic processing of qualitative processes
Clifton McFate and Kenneth Forbus. 2016 · 2016
Earlier work this paper cites.
Similar
Neural semantic parsing with type constraints for semi-structured tables
Jayant Krishnamurthy, Pradeep Dasigi, and Matthew Gardner. 2017 · 2017
Cited alongside, same era.
Race: Large-scale reading comprehension dataset from examinations
Guokun Lai, Qizhe Xie, Hanxiao Liu, Yiming Yang, and Eduard Hovy. 2017 · 2017
Cited alongside, same era.
Simple and effective multi-paragraph reading comprehension
Christopher Clark and Matt Gardner. 2018 · 2018
Cited alongside, same era.
Think you have solved question answering? Try ARC, the AI2 reasoning challenge
Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. 2018 · 2018
Cited alongside, same era.
Learning to build qualitative scenario models from natural language
M. Crouse, C. McFate, and K. Forbus. 2018 · 2018
Cited alongside, same era.
Then
AllenNLP: A deep semantic natural language processing platform
Matt Gardner, Joel Grus, Mark Neumann, Oyvind Tafjord, Pradeep Dasigi, Nelson Liu, Matthew Peters, Michael Schmitz, and Luke Zettlemoyer. 2018 · 2018
Later among the works it cites.
HotpotQA: A dataset for diverse, explainable multi-hop question answering
Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William W Cohen, Ruslan Salakhutdinov, and Christopher D Manning. 2018 · 2018
Later among the works it cites.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Closest in time.
Improving machine reading comprehension with general reading strategies
Kai Sun, Dian Yu, Dong Yu, and Claire Cardie. 2019 · 2019
Closest in time.
Quarel: A dataset and models for answering questions about qualitative relationships
Oyvind Tafjord, Peter Clark, Matt Gardner, Wen-tau Yih, and Ashish Sabharwal. 2019 · 2019
Closest in time.
Beyond the bibliography
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…