Fetching the paper…
Reading the bibliography…
Although pretrained language models (PTLMs) have been shown to contain significant amounts of world knowledge, they can still produce inconsistent answers to questions when probed, even after using specialized training techniques to reduce inconsistency.
Mental models : Towards a cognitive science of language
P. Johnson-Laird. 1983 · 1983
Earlier work this paper cites.
Probabilistic satisfiability
Pierre Hansen and Brigitte Jaumard. 2000 · 2000
Earlier work this paper cites.
Easy cases of probabilistic satisfiability
Kim Allan Andersen and Daniele Pretolani. 2001 · 2001
Earlier work this paper cites.
Logic-guided data augmentation and regularization for consistent question answering
Akari Asai and Hannaneh Hajishirzi. 2020 · 2004
Earlier work this paper cites.
Wordnet and wordnets
Christiane Fellbaum. 2005 · 2005
Earlier work this paper cites.
Z3: An efficient SMT solver
Leonardo De Moura and Nikolaj Bjørner. 2008 · 2008
Earlier work this paper cites.
Measuring inconsistency in probabilistic knowledge bases
Matthias Thimm. 2009 · 2009
Earlier work this paper cites.
Global learning of focused entailment graphs
Jonathan Berant, Ido Dagan, and Jacob Goldberger. 2010 · 2010
Earlier work this paper cites.
Probabilistic similarity logic
Matthias Broecheler, Lilyana Mihalkova, and L. Getoor. 2010 · 2010
Earlier work this paper cites.
Measuring and repairing inconsistency in probabilistic knowledge bases
David Picado Muiño. 2011 · 2011
Earlier work this paper cites.
Knowledge graph identification
J. Pujara, H. Miao, L. Getoor, and William W. Cohen. 2013 · 2013
Earlier work this paper cites.
Inconsistency measures for probabilistic logics
Matthias Thimm. 2013 · 2013
Cited alongside, same era.
End-to-end memory networks
Sainbayar Sukhbaatar, Arthur D. Szlam, J. Weston, and R. Fergus. 2015 · 2015
Cited alongside, same era.
Tracking the world state with recurrent entity networks
Mikael Henaff, J. Weston, Arthur D. Szlam, Antoine Bordes, and Y. LeCun. 2016 · 2016
Cited alongside, same era.
Bidirectional attention flow for machine comprehension
Minjoon Seo, Aniruddha Kembhavi, Ali Farhadi, and Hannaneh Hajishirzi. 2016 · 2016
Cited alongside, same era.
Conceptnet 5.5: An open multilingual graph of general knowledge
Robyn Speer, Joshua Chin, and Catherine Havasi. 2017 · 2017
Cited alongside, same era.
Adversarially regularising neural NLI models to integrate logical background knowledge
Are red roses red? Evaluating consistency of question-answering models
Marco Tulio Ribeiro, Carlos Guestrin, and Sameer Singh. 2019 · 2019
Later among the works it cites.
What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language models
Allyson Ettinger. 2020 · 2020
Later among the works it cites.
Negated and misprimed probes for pretrained language models: Birds can talk, but cannot fly
Nora Kassner and H. Schütze. 2020 · 2020
Later among the works it cites.
UnifiedQA: Crossing format boundaries with a single QA system
Daniel Khashabi, Sewon Min, Tushar Khot, Ashish Sabharwal, Oyvind Tafjord, P. Clark, and Hannaneh Hajishirzi. 2020 · 2020
Later among the works it cites.
On the systematicity of probing contextualized word representations: The case of hypernymy in BERT
Abhilasha Ravichander, Eduard Hovy, Kaheer Suleman, Adam Trischler, and Jackie Chi Kit Cheung. 2020 · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Pasquale Minervini and S. Riedel. 2018 · 2018
Cited alongside, same era.
Reasoning about actions and state changes by injecting commonsense knowledge
Niket Tandon, Bhavana Dalvi, Joel Grus, Wen-tau Yih, Antoine Bosselut, and Peter Clark. 2018 · 2018
Cited alongside, same era.
Commonsense knowledge mining from pretrained models
Joe Davison, Joshua Feldman, and Alexander Rush. 2019 · 2019
Cited alongside, same era.
Be consistent! Improving procedural text comprehension using label consistency
X. Du, Bhavana Dalvi Mishra, Niket Tandon, Antoine Bosselut, Wen-tau Yih, P. Clark, and Claire Cardie. 2019 · 2019
Cited alongside, same era.
A logic-driven framework for consistency of neural models
Tao Li, Vivek Gupta, Maitrey Mehta, and Vivek Srikumar. 2019 · 2019
Cited alongside, same era.
Language models as knowledge bases?
F. Petroni, Tim Rocktäschel, Patrick Lewis, A. Bakhtin, Yuxiang Wu, Alexander H. Miller, and S. Riedel. 2019 · 2019
Cited alongside, same era.
How much knowledge can you pack into the parameters of a language model?
Adam Roberts, Colin Raffel, and Noam Shazeer. 2020 · 2020
Later among the works it cites.
Unsupervised commonsense question answering with self-talk
Vered Shwartz, Peter West, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi. 2020 · 2020
Later among the works it cites.
Obtaining faithful interpretations from compositional neural networks
Sanjay Subramanian, Ben Bogin, Nitish Gupta, Tomer Wolfson, Sameer Singh, Jonathan Berant, and Matt Gardner. 2020 · 2020
Later among the works it cites.
Sumithra Bhakthavatsalam, Daniel Khashabi, Tushar Khot, B. D. Mishra, Kyle Richardson, Ashish Sabharwal, Carissa Schoenick, Oyvind Tafjord, and P. Clark. 2021 · 2021
Closest in time.
Measuring and improving consistency in pretrained language models
Yanai Elazar, Nora Kassner, Shauli Ravfogel, Abhilasha Ravichander, E. Hovy, H. Schutze, and Yoav Goldberg. 2021 · 2021
Closest in time.