ElecBench: a Power Dispatch Evaluation Benchmark for Large Language Models

Understand

In response to the urgent demand for grid stability and the complex challenges posed by renewable energy integration and electricity market dynamics, the power sector increasingly seeks innovative technological solutions.

• In this context, large language models (LLMs) have become a key technology to improve efficiency and promote intelligent progress in the power sector with their excellent natural language processing, logical reasoning, and generalization capabilities.
• Despite their potential, the absence of a performance evaluation benchmark for LLM in the power sector has limited the effective application of these technologies.
• Addressing this gap, our study introduces "ElecBench", an evaluation benchmark of LLMs within the power sector.