LLM Hallucinations in Practical Code Generation: Phenomena, Mechanism, and Mitigation

Understand

Code generation aims to automatically generate code from input requirements, significantly enhancing development efficiency.

• Recent large language models (LLMs) based approaches have shown promising results and revolutionized code generation task.
• Despite the promising performance, LLMs often generate contents with hallucinations, especially for the code generation scenario requiring the handling of complex contextual dependencies in practical development process.
• Although previous study has analyzed hallucinations in LLM-powered code generation, the study is limited to standalone function generation.