Fetching the paper…

Reading the bibliography…

2024

RAGE Against the Machine: Retrieval-Augmented LLM Explanations

Rorseth, Joel, Godfrey, Parke, Golab, Lukasz et al.

Original
PDF
Post on X

Understand

This paper demonstrates RAGE, an interactive tool for explaining Large Language Models (LLMs) augmented with retrieval capabilities; i.e., able to query external sources and pull relevant information into their input context.

Our explanations are counterfactual in the sense that they identify parts of the input context that, when removed, change the answer to the question posed to the LLM.
RAGE includes pruning methods to navigate the vast space of possible explanations, allowing users to view the provenance of the produced answers.

RAGE Against the Machine: Retrieval-Augmented LLM Explanations · Around

Built on

R. A. Fisher and F. Yates, Statistical tables for biological, agricultural aad medical research . Edinburgh: Oliver and Boyd, 1938
1938
Earlier work this paper cites.
C. R. Chegireddy and H. W. Hamacher, “Algorithms for finding k-best perfect matchings,” Discrete Applied Mathematics , vol. 18, no. 2, pp. 155–165, 1987
1987
Earlier work this paper cites.
J. Lin, X. Ma, S.-C. Lin, J.-H. Yang, R. Pradeep, and R. Nogueira, “Pyserini: A Python toolkit for reproducible information retrieval research with sparse and dense representations,” in SIGIR , 2021, pp. 2356–2362
2021
Earlier work this paper cites.

Similar

J. Wei, J. Wei, Y. Tay, D. Tran, A. Webson, Y. Lu, X. Chen, H. Liu, D. Huang, D. Zhou et al. , “Larger language models do in-context learning differently,” arXiv preprint arXiv:2303.03846 , 2023
Original
2023
Cited alongside, same era.
N. F. Liu, K. Lin, J. Hewitt, A. Paranjape, M. Bevilacqua, F. Petroni, and P. Liang, “Lost in the middle: How language models use long contexts,” 2023, arXiv:2307.03172
Original
2023
Cited alongside, same era.

Then

J. Rorseth, P. Godfrey, L. Golab, M. Kargar, D. Srivastava, and J. Szlichta, “Credence: Counterfactual explanations for document ranking,” in ICDE , 2023, pp. 3631–3634
2023
Later among the works it cites.
H. Touvron, L. Martin, K. Stone, P. Albert, A. Almahairi, Y. Babaei, N. Bashlykov, S. Batra, P. Bhargava, S. Bhosale et al. , “Llama 2: Open foundation and fine-tuned chat models,” arXiv:2307.09288 , 2023
Original
2023
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…