Context-aware Decoding Reduces Hallucination in Query-focused Summarization

Understand

Query-focused summarization (QFS) aims to provide a summary of a single document/multi documents that can satisfy the information needs of a given query.

• It is useful for various real-world applications, such as abstractive snippet generation or more recent retrieval augmented generation (RAG).
• A prototypical QFS pipeline consists of a retriever (sparse or dense retrieval) and a generator (usually a large language model).
• However, applying large language models (LLM) potentially leads to hallucinations, especially when the evidence contradicts the prior belief of LLMs.