Complex Logical Reasoning over Knowledge Graphs using Large Language Models

Yago: A core of semantic knowledge

Fabian M. Suchanek, Gjergji Kasneci, and Gerhard Weikum · 2007

Earlier work this paper cites.

Freebase: A collaboratively created graph database for structuring human knowledge

Kurt Bollacker, Colin Evans, Praveen Paritosh, Tim Sturge, and Jamie Taylor · 2008

Earlier work this paper cites.

Toward an architecture for never-ending language learning

Andrew Carlson, Justin Betteridge, Bryan Kisiel, Burr Settles, Estevam R. Hruschka, and Tom M. Mitchell · 2010

Earlier work this paper cites.

A three-way model for collective learning on multi-relational data

Maximilian Nickel, Volker Tresp, and Hans-Peter Kriegel · 2011

Earlier work this paper cites.

Translating embeddings for modeling multi-relational data

Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko · 2013

Earlier work this paper cites.

Representing text for joint embedding of text and knowledge bases

Kristina Toutanova, Danqi Chen, Patrick Pantel, Hoifung Poon, Pallavi Choudhury, and Michael Gamon · 2015

Earlier work this paper cites.

Chains of reasoning over entities, relations, and text using recurrent neural networks

Rajarshi Das, Arvind Neelakantan, David Belanger, and Andrew McCallum · 2017

Earlier work this paper cites.

Embedding logical queries on knowledge graphs

Will Hamilton, Payal Bajaj, Marinka Zitnik, Dan Jurafsky, and Jure Leskovec · 2018

Earlier work this paper cites.

Pytorch: An imperative style, high-performance deep learning library

Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala · 2019

Earlier work this paper cites.

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei · 2020

Earlier work this paper cites.

Realm: Retrieval-augmented language model pre-training

Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Ming-Wei Chang · 2020

Cited alongside, same era.

Deepspeed: System optimizations enable training deep learning models with over 100 billion parameters

Jeff Rasley, Samyam Rajbhandari, Olatunji Ruwase, and Yuxiong He · 2020

Cited alongside, same era.

Beta embeddings for multi-hop logical reasoning in knowledge graphs

Hongyu Ren and Jure Leskovec · 2020

Cited alongside, same era.

Query2box: Reasoning over knowledge graphs in vector space using box embeddings

Hongyu Ren, Weihua Hu, and Jure Leskovec · 2020

Cited alongside, same era.

Transformers: State-of-the-art natural language processing

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander Rush · 2020

Cited alongside, same era.

Palm: Scaling language modeling with pathways

Original

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al · 2022

Later among the works it cites.

Successive prompting for decomposing complex questions

Dheeru Dua, Shivanshu Gupta, Sameer Singh, and Matt Gardner · 2022

Later among the works it cites.

Maieutic prompting: Logically consistent reasoning with recursive explanations

Jaehun Jung, Lianhui Qin, Sean Welleck, Faeze Brahman, Chandra Bhagavatula, Ronan Le Bras, and Yejin Choi · 2022

Later among the works it cites.

Chain of thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed H. Chi, Quoc V Le, and Denny Zhou · 2022

Later among the works it cites.

Selection-inference: Exploiting large language models for interpretable logical reasoning

Antonia Creswell, Murray Shanahan, and Irina Higgins · 2023

Closest in time.