2024

GAIA -- A Large Language Model for Advanced Power Dispatch

Cheng, Yuheng, Zhao, Huan, Zhou, Xiyuan et al.

Understand

Power dispatch is essential for providing stable, cost-effective, and eco-friendly electricity to society.

However, traditional methods falter as power systems grow in scale and complexity, struggling with multitasking, swift problem-solving, and human-machine collaboration.
This paper introduces GAIA, the pioneering Large Language Model (LLM) tailored for power dispatch tasks.
We have developed a novel dataset construction technique that harnesses a range of data sources to fine-tune GAIA for optimal performance in this domain.

Built on

Parameter-efficient transfer learning for nlp
Original
Houlsby, N., Giurgiu, A., Jastrzebski, S., Morrone, B., de Laroussilhe, Q., Gesmundo, A., Attariyan, M., Gelly, S., 2019 · 1902
Earlier work this paper cites.
Fast transformer decoding: One write-head is all you need
Original
Shazeer, N., 2019 · 1911
Earlier work this paper cites.
Monte carlo sampling methods using markov chains and their applications
Hastings, W.K., 1970 · 1970
Earlier work this paper cites.
A united approach to optimal real and reactive power dispatch
Lee, K., Park, Y., Ortiz, J., 1985 · 1985
Earlier work this paper cites.
A review of recent advances in economic dispatch
Chowdhury, B.H., Rahman, S., 1990 · 1990
Earlier work this paper cites.
Glu variants improve transformer
Original
Shazeer, N., 2020 · 2002
Earlier work this paper cites.
Multi-head attention: Collaborate instead of concatenate
Original
Cordonnier, J.B., Loukas, A., Jaggi, M., 2020 · 2006
Earlier work this paper cites.
Measuring massive multitask language understanding
Original
Hendrycks, D., Burns, C., Basart, S., Zou, A., Mazeika, M., Song, D., Steinhardt, J., 2021a · 2009
Earlier work this paper cites.
A survey on smart grid potential applications and communication requirements
Gungor, V.C., Sahin, D., Kocak, T., Ergut, S., Buccella, C., Cecati, C., Hancke, G.P., 2012 · 2012
Earlier work this paper cites.
Power generation, operation, and control
Wood, A.J., Wollenberg, B.F., Sheblé, G.B., 2013 · 2013
Earlier work this paper cites.
Power system monitoring and control
Bevrani, H., Watanabe, M., Mitani, Y., 2014 · 2014
Earlier work this paper cites.
Deep learning for fault diagnosis based on multi-sourced heterogeneous data, in: 2014 International Conference on Power System Technology, IEEE. pp. 740–745
Ma, Y., Guo, Z., Su, J., Chen, Y., Du, X., Yang, Y., Li, C., Lin, Y., Geng, Y., 2014 · 2014
Earlier work this paper cites.
A survey of fault diagnosis and fault-tolerant techniques—part i: Fault diagnosis with model-based and signal-based approaches
Gao, Z., Cecati, C., Ding, S.X., 2015 · 2015
Earlier work this paper cites.
Reinforcement learning for electric power system decision and control: Past considerations and perspectives
Glavic, M., Fonteneau, R., Ernst, D., 2017 · 2017
Earlier work this paper cites.

Similar

Proximal policy optimization algorithms
Original
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., Klimov, O., 2017 · 2017
Cited alongside, same era.
Active learning for convolutional neural networks: A core-set approach
Original
Sener, O., Savarese, S., 2017 · 2017
Cited alongside, same era.
Optimal black start allocation for power system restoration
Patsakis, G., Rajan, D., Aravena, I., Rios, J., Oren, S., 2018 · 2018
Cited alongside, same era.
Optimal load dispatch of community microgrid with deep learning based solar power and load forecasting
Wen, L., Zhou, K., Yang, S., Lu, X., 2019 · 2019
Cited alongside, same era.
Root mean square layer normalization
Zhang, B., Sennrich, R., 2019 · 2019
Cited alongside, same era.
Lora: Low-rank adaptation of large language models
Original
Hu, E.J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., Chen, W., 2021 · 2021
Cited alongside, same era.
Scaling instruction-finetuned language models
Original
Chung, H.W., Hou, L., Longpre, S., Zoph, B., Tay, Y., Fedus, W., Li, Y., Wang, X., Dehghani, M., Brahma, S., et al., 2022 · 2022
Cited alongside, same era.
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al., 2022 · 2022
Cited alongside, same era.
Gpt-4 technical report
Original
Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F.L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., et al., 2023 · 2023
Cited alongside, same era.
Gqa: Training generalized multi-query transformer models from multi-head checkpoints
Original
Ainslie, J., Lee-Thorp, J., de Jong, M., Zemlyanskiy, Y., Lebrón, F., Sanghai, S., 2023 · 2023
Cited alongside, same era.
The falcon series of open language models
Original
Almazrouei, E., Alobeidli, H., Alshamsi, A., Cappelli, A., Cojocaru, R., Debbah, M., Goffinet, É., Hesslow, D., Launay, J., Malartic, Q., et al., 2023 · 2023
Cited alongside, same era.
Nougat: Neural optical understanding for academic documents
Original
Blecher, L., Cucurull, G., Scialom, T., Stojnic, R., 2023 · 2023
Cited alongside, same era.

Then

Wizardmath: Empowering mathematical reasoning for large language models via reinforced evol-instruct
Original
Luo, H., Sun, Q., Xu, C., Zhao, P., Lou, J., Tao, C., Geng, X., Lin, Q., Chen, S., Zhang, D., 2023 · 2023
Later among the works it cites.
Code llama: Open foundation models for code
Original
Roziere, B., Gehring, J., Gloeckle, F., Sootla, S., Gat, I., Tan, X.E., Adi, Y., Liu, J., Remez, T., Rapin, J., et al., 2023 · 2023
Later among the works it cites.
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S.S., Wei, J., Chung, H.W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al., 2023 · 2023
Later among the works it cites.
Roformer: Enhanced transformer with rotary position embedding
Original
Su, J., Lu, Y., Pan, S., Murtadha, A., Wen, B., Liu, Y., 2023 · 2023
Later among the works it cites.
Introducing mpt-7b: A new standard for open-source, commercially usable llms
Team, M.N., 2023 · 2023
Later among the works it cites.
Computational social science in smart power systems: Reliability, resilience, and restoration
Valinejad, J., Mili, L., Yu, X., Van Der Wal, C.N., Xu, Y., 2023 · 2023
Later among the works it cites.
Self-instruct: Aligning language models with self-generated instructions
Original
Wang, Y., Kordi, Y., Mishra, S., Liu, A., Smith, N.A., Khashabi, D., Hajishirzi, H., 2023 · 2023
Later among the works it cites.
Chain-of-thought prompting elicits reasoning in large language models
Original
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., Zhou, D., 2023 · 2023
Later among the works it cites.
Darwin series: Domain specific large language models for natural science
Original
Xie, T., Wan, Y., Huang, W., Yin, Z., Liu, Y., Wang, S., Linghu, Q., Kit, C., Grazian, C., Zhang, W., et al., 2023 · 2023
Later among the works it cites.
Instruction tuning for large language models: A survey
Original
Zhang, S., Dong, L., Li, X., Zhang, S., Sun, X., Wang, S., Li, J., Hu, R., Zhang, T., Wu, F., et al., 2023 · 2023
Later among the works it cites.
A survey of large language models
Original
Zhao, W.X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al., 2023 · 2023
Later among the works it cites.
Survey on large language model-enhanced reinforcement learning: Concept, taxonomy, and methods
Original
Cao, Y., Zhao, H., Cheng, Y., Shu, T., Liu, G., Liang, G., Zhao, J., Li, Y., 2024 · 2024
Closest in time.
Lfllm: A large language model for load forecasting
Liu, G., Bai, Y., Wen, K., Wang, X., Liu, Y., Liang, G., Zhao, J., Dong, Z.Y., 2024 · 2024
Closest in time.
Elecbench: A power dispatch evaluation benchmark for large language models
Original
Zhou, X., Zhao, H., Cheng, Y., Cao, Y., Liang, G., Liu, G., Zhao, J., 2024 · 2024
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…