CLUE: Concept-Level Uncertainty Estimation for Large Language Models

Understand

Large Language Models (LLMs) have demonstrated remarkable proficiency in various natural language generation (NLG) tasks.

• Previous studies suggest that LLMs' generation process involves uncertainty.
• However, existing approaches to uncertainty estimation mainly focus on sequence-level uncertainty, overlooking individual pieces of information within sequences.
• These methods fall short in separately assessing the uncertainty of each component in a sequence.