Large Language Models as Test Case Generators: Performance Evaluation and Enhancement

Understand

Code generation with Large Language Models (LLMs) has been extensively studied and achieved remarkable progress.

• As a complementary aspect to code generation, test case generation is of crucial importance in ensuring the quality and reliability of code.
• However, using LLMs as test case generators has been much less explored.
• Current research along this line primarily focuses on enhancing code generation with assistance from test cases generated by LLMs, while the performance of LLMs in test case generation alone has not been comprehensively examined.