Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-Oasis

Understand

After the introduction of Large Language Models (LLMs), there have been substantial improvements in the performance of Natural Language Generation (NLG) tasks, including Text Summarization and Machine Translation.

• However, LLMs still produce outputs containing hallucinations, that is, content not grounded in factual information.
• Therefore, developing methods to assess the factuality of LLMs has become urgent.
• Indeed, resources for factuality evaluation have recently emerged.