EffiBench: Benchmarking the Efficiency of Automatically Generated Code

Understand

Code generation models have increasingly become integral to aiding software development.

• Although current research has thoroughly examined the correctness of the code produced by code generation models, a vital aspect that plays a pivotal role in green computing and sustainability efforts has often been neglected.
• This paper presents EffiBench, a benchmark with 1,000 efficiency-critical coding problems to assess the efficiency of code generated by code generation models.
• EffiBench contains a diverse set of LeetCode coding problems.