Why Does ChatGPT Fall Short in Providing Truthful Answers?

Understand

Recent advancements in large language models, such as ChatGPT, have demonstrated significant potential to impact various aspects of human life.

• However, ChatGPT still faces challenges in providing reliable and accurate answers to user questions.
• To better understand the model's particular weaknesses in providing truthful answers, we embark an in-depth exploration of open-domain question answering.
• Specifically, we undertake a detailed examination of ChatGPT's failures, categorized into: comprehension, factuality, specificity, and inference.