Large Language Models Meet NL2Code: A Survey

Understand

The task of generating code from a natural language description, or NL2Code, is considered a pressing and significant challenge in code intelligence.

• Thanks to the rapid development of pre-training techniques, surging large language models are being proposed for code, sparking the advances in NL2Code.
• To facilitate further research and applications in this field, in this paper, we present a comprehensive survey of 27 existing large language models for NL2Code, and also review benchmarks and metrics.
• We provide an intuitive comparison of all existing models on the HumanEval benchmark.