Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps

What does bert look at? an analysis of bert’s attention

Original

Kevin Clark, Urvashi Khandelwal, Omer Levy, and Christopher D Manning. 2019 · 1906

Earlier work this paper cites.

Attention interpretability across nlp tasks

Original

Shikhar Vashishth, Shyam Upadhyay, Gaurav Singh Tomar, and Manaal Faruqui. 2019 · 1909

Earlier work this paper cites.

Rouge: A package for automatic evaluation of summaries

Chin-Yew Lin. 2004 · 2004

Earlier work this paper cites.

On faithfulness and factuality in abstractive summarization

Original

Joshua Maynez, Shashi Narayan, Bernd Bohnet, and Ryan McDonald. 2020 · 2005

Earlier work this paper cites.

Neural machine translation by jointly learning to align and translate

Dzmitry Bahdanau, Kyung Hyun Cho, and Yoshua Bengio. 2015 · 2015

Earlier work this paper cites.

Effective approaches to attention-based neural machine translation

Minh-Thang Luong, Hieu Pham, and Christopher D Manning. 2015 · 2015

Earlier work this paper cites.

Get to the point: Summarization with pointer-generator networks

Abigail See, Peter J Liu, and Christopher D Manning. 2017 · 2017

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Don’t give me the details, just the summary! topic-aware convolutional neural networks for extreme summarization

Shashi Narayan, Shay B Cohen, and Mirella Lapata. 2018 · 2018

Earlier work this paper cites.

FEVER: a large-scale dataset for fact extraction and VERification

James Thorne, Andreas Vlachos, Christos Christodoulopoulos, and Arpit Mittal. 2018 · 2018

Earlier work this paper cites.

Plug and play language models: A simple approach to controlled text generation

Sumanth Dathathri, Andrea Madotto, Janice Lan, Jane Hung, Eric Frank, Piero Molino, Jason Yosinski, and Rosanne Liu. 2019 · 2019

Earlier work this paper cites.

Natural questions: a benchmark for question answering research

Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, et al. 2019 · 2019

Earlier work this paper cites.

Retrieval-augmented generation for knowledge-intensive nlp tasks

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. 2020 · 2020

Earlier work this paper cites.

Qafacteval: Improved qa-based factual consistency evaluation for summarization

Original

Alexander R Fabbri, Chien-Sheng Wu, Wenhao Liu, and Caiming Xiong. 2021 · 2021

Earlier work this paper cites.

Self-attention attribution: Interpreting information interactions inside transformer

Yaru Hao, Li Dong, Furu Wei, and Ke Xu. 2021 · 2021

Earlier work this paper cites.

Debertav3: Improving deberta using electra-style pre-training with gradient-disentangled embedding sharing

Original

Pengcheng He, Jianfeng Gao, and Weizhu Chen. 2021 · 2021

Cited alongside, same era.

Get your vitamin C! robust fact verification with contrastive evidence

Tal Schuster, Adam Fisch, and Regina Barzilay. 2021 · 2021

Cited alongside, same era.

Fudge: Controlled text generation with future discriminators

Kevin Yang and Dan Klein. 2021 · 2021

Cited alongside, same era.

True: Re-evaluating factual consistency evaluation

Or Honovich, Roee Aharoni, Jonathan Herzig, Hagai Taitelbaum, Doron Kukliansy, Vered Cohen, Thomas Scialom, Idan Szpektor, Avinatan Hassidim, and Yossi Matias. 2022 · 2022

Cited alongside, same era.

Summac: Re-visiting nli-based models for inconsistency detection in summarization

Philippe Laban, Tobias Schnabel, Paul N Bennett, and Marti A Hearst. 2022 · 2022

Cited alongside, same era.

G-eval: Nlg evaluation using gpt-4 with better human alignment

Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, and Chenguang Zhu. 2023 · 2023

Later among the works it cites.

When not to trust language models: Investigating effectiveness of parametric and non-parametric memories

Alex Mallen, Akari Asai, Victor Zhong, Rajarshi Das, Daniel Khashabi, and Hannaneh Hajishirzi. 2023 · 2023

Later among the works it cites.

Factscore: Fine-grained atomic evaluation of factual precision in long form text generation

Original

Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Wei Koh, Mohit Iyyer, Luke Zettlemoyer, and Hannaneh Hajishirzi. 2023 · 2023

Later among the works it cites.

Disentqa: Disentangling parametric and contextual knowledge with counterfactual question answering

Ella Neeman, Roee Aharoni, Or Honovich, Leshem Choshen, Idan Szpektor, and Omri Abend. 2023 · 2023

Later among the works it cites.

Gpt-4 technical report

OpenAI. 2023 · 2023

Later among the works it cites.