CONFLARE: CONFormal LArge language model REtrieval

Understand

Retrieval-augmented generation (RAG) frameworks enable large language models (LLMs) to retrieve relevant information from a knowledge base and incorporate it into the context for generating responses.

• This mitigates hallucinations and allows for the updating of knowledge without retraining the LLM.
• However, RAG does not guarantee valid responses if retrieval fails to identify the necessary information as the context for response generation.
• Also, if there is contradictory content, the RAG response will likely reflect only one of the two possible responses.