A Survey of Large Language Models for Code: Evolution, Benchmarking, and Future Trends

Understand

General large language models (LLMs), represented by ChatGPT, have demonstrated significant potential in tasks such as code generation in software engineering.

• This has led to the development of specialized LLMs for software engineering, known as Code LLMs.
• A considerable portion of Code LLMs is derived from general LLMs through model fine-tuning.
• As a result, Code LLMs are often updated frequently and their performance can be influenced by the base LLMs.