Retrieval-Generation Synergy Augmented Large Language Models

M. Joshi, E. Choi, D. Weld, and L. Zettlemoyer, “TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension,” in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . Vancouver, Canada: Association for Computational Linguistics, Jul. 2017, pp. 1601–1611. [Online]. Available: https://aclanthology.org/P17-1147

2017

Earlier work this paper cites.

R. Zellers, Y. Bisk, R. Schwartz, and Y. Choi, “SWAG: A large-scale adversarial dataset for grounded commonsense inference,” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing . Brussels, Belgium: Association for Computational Linguistics, Oct.-Nov. 2018, pp. 93–104. [Online]. Available: https://www.aclweb.org/anthology/D18-1009

2018

Earlier work this paper cites.

Z. Yang et al. , “HotpotQA: A dataset for diverse, explainable multi-hop question answering,” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing . Brussels, Belgium: Association for Computational Linguistics, Oct.-Nov. 2018, pp. 2369–2380. [Online]. Available: https://aclanthology.org/D18-1259

2018

Earlier work this paper cites.

K. Lee, M.-W. Chang, and K. Toutanova, “Latent retrieval for weakly supervised open domain question answering,” in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics . Florence, Italy: Association for Computational Linguistics, Jul. 2019, pp. 6086–6096. [Online]. Available: https://aclanthology.org/P19-1612

2019

Earlier work this paper cites.

T. Kwiatkowski et al. , “Natural questions: A benchmark for question answering research,” Transactions of the Association for Computational Linguistics , vol. 7, pp. 452–466, 2019. [Online]. Available: https://aclanthology.org/Q19-1026

2019

Earlier work this paper cites.

T. Brown et al. , “Language models are few-shot learners,” Advances in neural information processing systems , vol. 33, pp. 1877–1901, 2020

2020

Earlier work this paper cites.

G. Izacard and E. Grave, “Leveraging passage retrieval with generative models for open domain question answering,” arXiv preprint arXiv:2007.01282 , 2020

Original

2020

Earlier work this paper cites.

X. Ho, A.-K. Duong Nguyen, S. Sugawara, and A. Aizawa, “Constructing a multi-hop QA dataset for comprehensive evaluation of reasoning steps,” in Proceedings of the 28th International Conference on Computational Linguistics . Barcelona, Spain (Online): International Committee on Computational Linguistics, Dec. 2020, pp. 6609–6625. [Online]. Available: https://aclanthology.org/2020.coling-main.580

2020

Earlier work this paper cites.

J. Hoffmann et al. , “Training compute-optimal large language models,” 2022

2022

Cited alongside, same era.

A. Zeng et al. , “Glm-130b: An open bilingual pre-trained model,” arXiv preprint arXiv:2210.02414 , 2022

Original

2022

Cited alongside, same era.

A. Chowdhery et al. , “Palm: Scaling language modeling with pathways,” arXiv preprint arXiv:2204.02311 , 2022

Original

2022

Cited alongside, same era.

H. Trivedi, N. Balasubramanian, T. Khot, and A. Sabharwal, “Interleaving retrieval with chain-of-thought reasoning for knowledge-intensive multi-step questions,” arXiv preprint arXiv:2212.10509 , 2022

Original

2022

Cited alongside, same era.

L. Ouyang et al. , “Training language models to follow instructions with human feedback,” Advances in Neural Information Processing Systems , vol. 35, pp. 27 730–27 744, 2022

H. Touvron et al. , “Llama: Open and efficient foundation language models,” 2023

2023

Closest in time.

O. Ram et al. , “In-context retrieval-augmented language models,” arXiv preprint arXiv:2302.00083 , 2023

Original

2023

Closest in time.

O. Khattab et al. , “Demonstrate-search-predict: Composing retrieval and language models for knowledge-intensive nlp,” 2023

2023

Closest in time.

W. Shi et al. , “Replug: Retrieval-augmented black-box language models,” arXiv preprint arXiv:2301.12652 , 2023

Original

2023

Closest in time.

W. Yu et al. , “Generate rather than retrieve: Large language models are strong context generators,” 2023

2023

Closest in time.