Inductive Learning of Logical Theories with LLMs: An Expressivity-Graded Analysis

Inductive logic programming

Muggleton, S. 1991 · 1991

Earlier work this paper cites.

On computational complexity of Prolog programs

Dikovsky, A. J. 1993 · 1993

Earlier work this paper cites.

What is inductive logic programming?

Nienhuys-Cheng, S.-H.; and de Wolf, R. 1997 · 1997

Earlier work this paper cites.

Differentiable learning of logical rules for knowledge base reasoning

Yang, F.; Yang, Z.; and Cohen, W. W. 2017 · 2017

Earlier work this paper cites.

Language models are unsupervised multitask learners

Radford, A.; Wu, J.; Child, R.; Luan, D.; Amodei, D.; Sutskever, I.; et al. 2019 · 2019

Earlier work this paper cites.

CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from Text

Sinha, K.; Sodhani, S.; Dong, J.; Pineau, J.; and Hamilton, W. L. 2019 · 2019

Earlier work this paper cites.

Language models are few-shot learners

Brown, T. B.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; Agarwal, S.; Herbert-Voss, A.; Krueger, G.; Henighan, T.; Child, R.; Ramesh, A.; Ziegler, D. M.; Wu, J.; Winter, C.; Hesse, C.; Chen, M.; Sigler, E.; Litwin, M.; Gray, S.; Chess, B.; Clark, J.; Berner, C.; McCandlish, S.; Radford, A.; Sutskever, I.; and Amodei, D. 2020 · 2020

Cited alongside, same era.

Synthetic Datasets and Evaluation Tools for Inductive Neural Reasoning

Cornelio, C.; and Thost, V. 2021 · 2021

Cited alongside, same era.

Learning programs by learning from failures

Cropper, A.; and Morel, R. 2021 · 2021

Cited alongside, same era.

NuWLS: Improving Local Search for (Weighted) Partial MaxSAT by New Weighting Techniques

Chu, Y.; Cai, S.; and Luo, C. 2023 · 2023

Cited alongside, same era.

Faith and Fate: Limits of Transformers on Compositionality

Original

Dziri, N.; Lu, X.; Sclar, M.; Li, X. L.; Jian, L.; Lin, B. Y.; West, P.; Bhagavatula, C.; Bras, R. L.; Hwang, J. D.; et al. 2023 · 2023

Cited alongside, same era.

Mistral 7B

Original

Jiang, A. Q.; Sablayrolles, A.; Mensch, A.; Bamford, C.; Chaplot, D. S.; Casas, D. d. l.; Bressand, F.; Lengyel, G.; Lample, G.; Saulnier, L.; et al. 2023 · 2023

Later among the works it cites.

Self-Refine: Iterative Refinement with Self-Feedback

Original

Madaan, A.; Tandon, N.; Gupta, P.; Hallinan, S.; Gao, L.; Wiegreffe, S.; Alon, U.; Dziri, N.; Prabhumoye, S.; Yang, Y.; Welleck, S.; Majumder, B. P.; Gupta, S.; Yazdanbakhsh, A.; and Clark, P. 2023 · 2023

Later among the works it cites.

Gemini: a family of highly capable multimodal models

Original

Team, G.; Anil, R.; Borgeaud, S.; Wu, Y.; Alayrac, J.-B.; Yu, J.; Soricut, R.; Schalkwyk, J.; Dai, A. M.; Hauth, A.; et al. 2023 · 2023

Later among the works it cites.

Prolog: The Next 50 Years , volume 13900

Warren, D. S.; Dahl, V.; Eiter, T.; Hermenegildo, M. V.; Kowalski, R.; and Rossi, F. 2023 · 2023

Later among the works it cites.

A & B == B & A: Triggering Logical Reasoning Failures in Large Language Models