Hallucination is Inevitable: An Innate Limitation of Large Language Models

Understand

Hallucination has been widely recognized to be a significant drawback for large language models (LLMs).

• There have been many works that attempt to reduce the extent of hallucination.
• These efforts have mostly been empirical so far, which cannot answer the fundamental question whether it can be completely eliminated.
• In this paper, we formalize the problem and show that it is impossible to eliminate hallucination in LLMs.