Fetching the paper…
Reading the bibliography…
Language models (LMs) pretrained on large corpora of text from the web have been observed to contain large amounts of various types of knowledge about the world.
Wordnet: a lexical database for english
George A Miller · 1995
Earlier work this paper cites.
Bill Yuchen Lin, Seyeon Lee, Rahul Khanna, and Xiang Ren · 2005
Earlier work this paper cites.
Toward an architecture for never-ending language learning
Andrew Carlson, Justin Betteridge, Bryan Kisiel, Burr Settles, Estevam R Hruschka, and Tom M Mitchell · 2010
Earlier work this paper cites.
Differentiable open-ended commonsense reasoning
Bill Yuchen Lin, Haitian Sun, Bhuwan Dhingra, Manzil Zaheer, Xiang Ren, and William W Cohen · 2010
Earlier work this paper cites.
Translating embeddings for modeling multi-relational data
Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko · 2013
Earlier work this paper cites.
Knowledge vault: A web-scale approach to probabilistic knowledge fusion
Xin Dong, Evgeniy Gabrilovich, Geremy Heitz, Wilko Horn, Ni Lao, Kevin Murphy, Thomas Strohmann, Shaohua Sun, and Wei Zhang · 2014
Earlier work this paper cites.
Wikidata: a free collaborative knowledgebase
Denny Vrandečić and Markus Krötzsch · 2014
Earlier work this paper cites.
Commonsense knowledge base completion
Xiang Li, Aynaz Taheri, Lifu Tu, and Kevin Gimpel · 2016
Earlier work this paper cites.
Complex embeddings for simple link prediction
Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier, and Guillaume Bouchard · 2016
Earlier work this paper cites.
Conceptnet 5.5: An open multilingual graph of general knowledge
Robyn Speer, Joshua Chin, and Catherine Havasi · 2017
Earlier work this paper cites.
Simple embedding for link prediction in knowledge graphs
Seyed Mehran Kazemi and David Poole · 2018
Earlier work this paper cites.
Comet: Commonsense transformers for automatic knowledge graph construction
Antoine Bosselut, Hannah Rashkin, Maarten Sap, Chaitanya Malaviya, Asli Celikyilmaz, and Yejin Choi · 2019
Earlier work this paper cites.
Commonsense knowledge mining from pretrained models
Joe Davison, Joshua Feldman, and Alexander M Rush · 2019
Earlier work this paper cites.
Mrqa 2019 shared task: Evaluating generalization in reading comprehension
Adam Fisch, Alon Talmor, Robin Jia, Minjoon Seo, Eunsol Choi, and Danqi Chen · 2019
Earlier work this paper cites.
Language models as knowledge bases?
Fabio Petroni, Tim Rocktäschel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, Alexander H Miller, and Sebastian Riedel · 2019
Earlier work this paper cites.
Exploring the limits of transfer learning with a unified text-to-text transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu · 2019
Earlier work this paper cites.
Atomic: An atlas of machine commonsense for if-then reasoning
Maarten Sap, Ronan Le Bras, Emily Allaway, Chandra Bhagavatula, Nicholas Lourie, Hannah Rashkin, Brendan Roof, Noah A Smith, and Yejin Choi · 2019
Earlier work this paper cites.
Multiqa: An empirical investigation of generalization and transfer in reading comprehension
Alon Talmor and Jonathan Berant · 2019
Cited alongside, same era.
Genericskb: A knowledge base of generic statements
Sumithra Bhakthavatsalam, Chloe Anastasiades, and Peter Clark · 2020
Cited alongside, same era.
Diachronic embedding for temporal knowledge graph completion
Rishab Goel, Seyed Mehran Kazemi, Marcus Brubaker, and Pascal Poupart · 2020
Cited alongside, same era.
Mutant: A training paradigm for out-of-distribution generalization in visual question answering
Tejas Gokhale, Pratyay Banerjee, Chitta Baral, and Yezhou Yang · 2020
Cited alongside, same era.
How can we know what language models know?
Zhengbao Jiang, Frank F Xu, Jun Araki, and Graham Neubig · 2020
Cited alongside, same era.
Challenges in generalization in open domain question answering
Linqing Liu, Patrick Lewis, Sebastian Riedel, and Pontus Stenetorp · 2021
Later among the works it cites.
Ensemble of deep masked language models for effective named entity recognition in health and life science corpora
Nona Naderi, Julien Knafou, Jenny Copara, Patrick Ruch, and Douglas Teodoro · 2021
Later among the works it cites.
P-adapters: Robustly extracting factual information from language models with diverse prompts
Benjamin Newman, Prafulla Kumar Choubey, and Nazneen Rajani · 2021
Later among the works it cites.
Relational world knowledge representation in contextual language models: A review
Tara Safavi and Danai Koutra · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Tensor decompositions for temporal knowledge base completion
Timothée Lacroix, Guillaume Obozinski, and Nicolas Usunier · 2020
Cited alongside, same era.
Question and answer test-train overlap in open-domain question answering datasets
Patrick Lewis, Pontus Stenetorp, and Sebastian Riedel · 2020
Cited alongside, same era.
Quesbelm: A bert based ensemble language model for natural questions
Raj Ratn Pranesh, Ambesh Shekhar, and Smita Pallavi · 2020
Cited alongside, same era.
Autoprompt: Eliciting knowledge from language models with automatically generated prompts
Taylor Shin, Yasaman Razeghi, Robert L Logan IV, Eric Wallace, and Sameer Singh · 2020
Cited alongside, same era.
Do language embeddings capture scales?
Xikun Zhang, Deepak Ramachandran, Ian Tenney, Yanai Elazar, and Dan Roth · 2020
Cited alongside, same era.
Evaluating commonsense in pre-trained language models
Xuhui Zhou, Yue Zhang, Leyang Cui, and Dandan Huang · 2020
Cited alongside, same era.
Knowledgeable or educated guess? revisiting language models as knowledge bases
Boxi Cao, Hongyu Lin, Xianpei Han, Le Sun, Lingyong Yan, Meng Liao, Tong Xue, and Jin Xu · 2021
Cited alongside, same era.
Zheyan Shen, Jiashuo Liu, Yue He, Xingxuan Zhang, Renzhe Xu, Han Yu, and Peng Cui · 2021
Later among the works it cites.
Can language models be biomedical knowledge bases?
Mujeen Sung, Jinhyuk Lee, Sean Yi, Minji Jeon, Sungdong Kim, and Jaewoo Kang · 2021
Later among the works it cites.
Bertnesia: Investigating the capture and forgetting of knowledge in bert
Jonas Wallat, Jaspreet Singh, and Avishek Anand · 2021
Later among the works it cites.
Symbolic knowledge distillation: from general language models to commonsense models
Peter West, Chandra Bhagavatula, Jack Hessel, Jena D Hwang, Liwei Jiang, Ronan Le Bras, Ximing Lu, Sean Welleck, and Yejin Choi · 2021
Later among the works it cites.
If you want to go far go together: Unsupervised joint candidate evidence retrieval for multi-hop question answering
Vikas Yadav, Steven Bethard, and Mihai Surdeanu · 2021
Later among the works it cites.
Factual probing is [mask]: Learning vs. learning to recall
Zexuan Zhong, Dan Friedman, and Danqi Chen · 2021
Later among the works it cites.
A review on language models as knowledge bases
Badr AlKhamissi, Millicent Li, Asli Celikyilmaz, Mona Diab, and Marjan Ghazvininejad · 2022
Later among the works it cites.
Penguins don’t fly: Reasoning about generics through instantiations and exceptions
Emily Allaway, Jena D Hwang, Chandra Bhagavatula, Kathleen McKeown, Doug Downey, and Yejin Choi · 2022
Later among the works it cites.
Bertnet: Harvesting knowledge graphs from pretrained language models
Shibo Hao, Bowen Tan, Kaiwen Tang, Hengzhe Zhang, Eric P Xing, and Zhiting Hu · 2022
Later among the works it cites.
Short-answer scoring with ensembles of pretrained language models
Christopher Ormerod · 2022
Later among the works it cites.
Self-consistency improves chain of thought reasoning in language models
Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, and Denny Zhou · 2022
Later among the works it cites.
Geomlama: Geo-diverse commonsense probing on multilingual pre-trained language models
Da Yin, Hritik Bansal, Masoud Monajatipoor, Liunian Harold Li, and Kai-Wei Chang · 2022
Later among the works it cites.