Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models

The probable error of a mean

Student. 1908 · 1908

Earlier work this paper cites.

Statistical power analysis for the behavioral sciences , 2nd edition

Jacob Cohen. 1988 · 1988

Earlier work this paper cites.

Causality: Models, reasoning, and inference

Judea Pearl. 2000 · 2000

Earlier work this paper cites.

Direct and indirect effects

Judea Pearl. 2001 · 2001

Earlier work this paper cites.

Retrieval-augmented generation for knowledge-intensive NLP tasks

Original

Patrick Lewis, Ethan Perez, Aleksandara Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Kuttler, Mike Lewis, Wen tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. 2020 · 2005

Earlier work this paper cites.

Natural questions: A benchmark for question answering research

Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov. 2019 · 2019

Earlier work this paper cites.

Language models as knowledge bases?

Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, and Alexander Miller. 2019 · 2019

Earlier work this paper cites.

How much knowledge can you pack into the parameters of a language model?

Adam Roberts, Colin Raffel, and Noam Shazeer. 2020 · 2020

Earlier work this paper cites.

Investigating gender bias in language models using causal mediation analysis

Jesse Vig, Sebastian Gehrmann, Yonatan Belinkov, Sharon Qian, Daniel Nevo, Yaron Singer, and Stuart Shieber. 2020 · 2020

Cited alongside, same era.

Editing factual knowledge in language models

Nicola De Cao, Wilker Aziz, and Ivan Titov. 2021 · 2021

Cited alongside, same era.

Entity-based knowledge conflicts in question answering

Shayne Longpre, Kartik Perisetla, Anthony Chen, Nikhil Ramesh, Chris DuBois, and Sameer Singh. 2021 · 2021

Cited alongside, same era.

Simple entity-centric questions challenge dense retrievers

Christopher Sciavolino, Zexuan Zhong, Jinhyuk Lee, and Danqi Chen. 2021 · 2021

Cited alongside, same era.

Rich knowledge sources bring complex knowledge conflicts: Recalibrating models to reflect conflicting evidence

Hung-Ting Chen, Michael Zhang, and Eunsol Choi. 2022 · 2022

Cited alongside, same era.

Large language models struggle to learn long-tail knowledge

Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, and Colin Raffel. 2023 · 2023

Later among the works it cites.

When not to trust language models: Investigating effectiveness of parametric and non-parametric memories

Alex Mallen, Akari Asai, Victor Zhong, Rajarshi Das, Daniel Khashabi, and Hannaneh Hajishirzi. 2023 · 2023

Later among the works it cites.

On the generalization ability of retrieval-enhanced transformers

Tobias Norlund, Ehsan Doostmohammadi, Richard Johansson, and Marco Kuhlmann. 2023 · 2023

Later among the works it cites.

Alternative measures of direct and indirect effects

Original

José M. Peña. 2023 · 2023

Later among the works it cites.

In-context retrieval-augmented language models

Ori Ram, Yoav Levine, Itay Dalmedigos, Dor Muhlgay, Amnon Shashua, Kevin Leyton-Brown, and Yoav Shoham. 2023 · 2023

Later among the works it cites.