LLM-Powered AI Agent Systems and Their Applications in Industry

W. Van Melle, “Mycin: a knowledge-based consultation program for infectious disease diagnosis,” International journal of man-machine studies , vol. 10, no. 3, pp. 313–322, 1978

1978

Earlier work this paper cites.

B. G. Buchanan and E. A. Feigenbaum, “Dendral and meta-dendral: Their applications dimension,” in Readings in artificial intelligence . Elsevier, 1981, pp. 313–322

1981

Earlier work this paper cites.

M. Wooldridge and N. R. Jennings, “Intelligent agents: Theory and practice,” The knowledge engineering review , vol. 10, no. 2, pp. 115–152, 1995

1995

Earlier work this paper cites.

E. Oliveira, K. Fischer, and O. Stepankova, “Multi-agent systems: which research for which applications,” Robotics and Autonomous Systems , vol. 27, no. 1-2, pp. 91–106, 1999

1999

Earlier work this paper cites.

R. S. Sutton, D. McAllester, S. Singh, and Y. Mansour, “Policy gradient methods for reinforcement learning with function approximation,” Advances in neural information processing systems , vol. 12, 1999

1999

Earlier work this paper cites.

T. H. Davenport and J. G. Harris, “Automated decision making comes of age,” MIT Sloan Management Review , vol. 46, no. 4, p. 83, 2005

2005

Earlier work this paper cites.

H. Van Hasselt, A. Guez, and D. Silver, “Deep reinforcement learning with double q-learning,” in Proceedings of the AAAI conference on artificial intelligence , vol. 30, no. 1, 2016

2016

Earlier work this paper cites.

K. Arulkumaran, M. P. Deisenroth, M. Brundage, and A. A. Bharath, “Deep reinforcement learning: A brief survey,” IEEE Signal Processing Magazine , vol. 34, no. 6, pp. 26–38, 2017

2017

Earlier work this paper cites.

D. Silver, J. Schrittwieser, K. Simonyan, I. Antonoglou, A. Huang, A. Guez, T. Hubert, L. Baker, M. Lai, A. Bolton et al. , “Mastering the game of go without human knowledge,” nature , vol. 550, no. 7676, pp. 354–359, 2017

2017

Earlier work this paper cites.

A. Dorri, S. S. Kanhere, and R. Jurdak, “Multi-agent systems: A survey,” Ieee Access , vol. 6, pp. 28 573–28 593, 2018

2018

Earlier work this paper cites.

P. Hernandez-Leal, B. Kartal, and M. E. Taylor, “A survey and critique of multiagent deep reinforcement learning,” Autonomous Agents and Multi-Agent Systems , vol. 33, no. 6, pp. 750–797, 2019

2019

Earlier work this paper cites.

H. Jang, J. Kim, J.-E. Jo, J. Lee, and J. Kim, “Mnnfast: A fast and scalable system architecture for memory-augmented neural networks,” in Proceedings of the 46th International Symposium on Computer Architecture , 2019, pp. 250–263

2019

Earlier work this paper cites.

T. T. Nguyen, N. D. Nguyen, and S. Nahavandi, “Deep reinforcement learning for multiagent systems: A review of challenges, solutions, and applications,” IEEE transactions on cybernetics , vol. 50, no. 9, pp. 3826–3839, 2020

2020

Earlier work this paper cites.

J. Clifton and E. Laber, “Q-learning: Theory and applications,” Annual Review of Statistics and Its Application , vol. 7, no. 1, pp. 279–301, 2020

2020

Earlier work this paper cites.

A. Kumar, A. Zhou, G. Tucker, and S. Levine, “Conservative q-learning for offline reinforcement learning,” Advances in neural information processing systems , vol. 33, pp. 1179–1191, 2020

2020

Earlier work this paper cites.

P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, H. Küttler, M. Lewis, W.-t. Yih, T. Rocktäschel et al. , “Retrieval-augmented generation for knowledge-intensive nlp tasks,” Advances in neural information processing systems , vol. 33, pp. 9459–9474, 2020

2020

Earlier work this paper cites.

J. Maynez, S. Narayan, B. Bohnet, and R. McDonald, “On faithfulness and factuality in abstractive summarization,” arXiv preprint arXiv:2005.00661 , 2020

Original

2020

Earlier work this paper cites.

S. Lu, M. Wang, S. Liang, J. Lin, and Z. Wang, “Hardware accelerator for multi-head attention and position-wise feed-forward in the transformer,” in 2020 IEEE 33rd International System-on-Chip Conference (SOCC) . IEEE, 2020, pp. 84–89

2020

Earlier work this paper cites.

S. Gronauer and K. Diepold, “Multi-agent deep reinforcement learning: a survey,” Artificial Intelligence Review , vol. 55, no. 2, pp. 895–943, 2022

2022

Earlier work this paper cites.

A. M. Hafiz, “A survey of deep q-networks used for reinforcement learning: state of the art,” Intelligent Communication Technologies and Virtual Mobile Networks: Proceedings of ICICV 2022 , pp. 393–402, 2022

2022

Earlier work this paper cites.

E. Frantar, S. Ashkboos, T. Hoefler, and D. Alistarh, “Gptq: Accurate post-training quantization for generative pre-trained transformers,” arXiv preprint arXiv:2210.17323 , 2022

Original

2022

Earlier work this paper cites.

Z. Yao, R. Yazdani Aminabadi, M. Zhang, X. Wu, C. Li, and Y. He, “Zeroquant: Efficient and affordable post-training quantization for large-scale transformers,” Advances in Neural Information Processing Systems , vol. 35, pp. 27 168–27 183, 2022

2022

Earlier work this paper cites.

R. Behnia, M. R. Ebrahimi, J. Pacheco, and B. Padmanabhan, “Ew-tune: A framework for privately fine-tuning large language models with differential privacy,” in 2022 IEEE International Conference on Data Mining Workshops (ICDMW) . IEEE, 2022, pp. 560–566

2022

Earlier work this paper cites.

A. Lopez-Lira and Y. Tang, “Can chatgpt forecast stock price movements? return predictability and large language models,” arXiv preprint arXiv:2304.07619 , 2023

Original

2023

Earlier work this paper cites.

Y. Li, Y. Yu, H. Li, Z. Chen, and K. Khashanah, “Tradinggpt: Multi-agent system with layered memory and distinct characters for enhanced financial trading performance,” arXiv preprint arXiv:2309.03736 , 2023

Original

2023

Earlier work this paper cites.

S. Dikshit, A. Atiq, M. Shahid, V. Dwivedi, and A. Thusu, “The use of artificial intelligence to optimize the routing of vehicles and reduce traffic congestion in urban areas,” EAI Endorsed Transactions on Energy Web , vol. 10, pp. 1–13, 2023

2023

Earlier work this paper cites.

H. Naveed, A. U. Khan, S. Qiu, M. Saqib, S. Anwar, M. Usman, N. Akhtar, N. Barnes, and A. Mian, “A comprehensive overview of large language models,” arXiv preprint arXiv:2307.06435 , 2023

Original

2023

Earlier work this paper cites.

Y. Gao, Y. Xiong, X. Gao, K. Jia, J. Pan, Y. Bi, Y. Dai, J. Sun, H. Wang, and H. Wang, “Retrieval-augmented generation for large language models: A survey,” arXiv preprint arXiv:2312.10997 , vol. 2, 2023

Original

2023

Earlier work this paper cites.

Z. Ji, N. Lee, R. Frieske, T. Yu, D. Su, Y. Xu, E. Ishii, Y. J. Bang, A. Madotto, and P. Fung, “Survey of hallucination in natural language generation,” ACM computing surveys , vol. 55, no. 12, pp. 1–38, 2023

2023

Earlier work this paper cites.

H. Inan, K. Upasani, J. Chi, R. Rungta, K. Iyer, Y. Mao, M. Tontchev, Q. Hu, B. Fuller, D. Testuggine et al. , “Llama guard: Llm-based input-output safeguard for human-ai conversations,” arXiv preprint arXiv:2312.06674 , 2023

Original

2023

Earlier work this paper cites.

V. Kumar, P. Srivastava, A. Dwivedi, I. Budhiraja, D. Ghosh, V. Goyal, and R. Arora, “Large-language-models (llm)-based ai chatbots: Architecture, in-depth analysis and their performance evaluation,” in International Conference on Recent Trends in Image Processing and Pattern Recognition . Springer, 2023, pp. 237–249

2023

Earlier work this paper cites.

Y. R. Wang, J. Duan, D. Fox, and S. Srinivasa, “Newton: Are large language models capable of physical reasoning?” arXiv preprint arXiv:2310.07018 , 2023

Original

2023

Earlier work this paper cites.

S. Wang, H. Yuan, L. Zhou, L. M. Ni, H.-Y. Shum, and J. Guo, “Alpha-gpt: Human-ai interactive alpha mining for quantitative investment,” arXiv preprint arXiv:2308.00016 , 2023

Original

2023

Earlier work this paper cites.

Z. Liu, B. Oguz, C. Zhao, E. Chang, P. Stock, Y. Mehdad, Y. Shi, R. Krishnamoorthi, and V. Chandra, “Llm-qat: Data-free quantization aware training for large language models,” arXiv preprint arXiv:2305.17888 , 2023

Original

2023

Earlier work this paper cites.

G. Xiao, J. Lin, M. Seznec, H. Wu, J. Demouth, and S. Han, “Smoothquant: Accurate and efficient post-training quantization for large language models,” in International Conference on Machine Learning . PMLR, 2023, pp. 38 087–38 099

2023

Earlier work this paper cites.

X. Ma, G. Fang, and X. Wang, “Llm-pruner: On the structural pruning of large language models,” Advances in neural information processing systems , vol. 36, pp. 21 702–21 720, 2023

2023

Earlier work this paper cites.

E. Frantar and D. Alistarh, “Sparsegpt: Massive language models can be accurately pruned in one-shot,” in International Conference on Machine Learning . PMLR, 2023, pp. 10 323–10 337

2023

Earlier work this paper cites.

M. Sun, Z. Liu, A. Bair, and J. Z. Kolter, “A simple and effective pruning approach for large language models,” arXiv preprint arXiv:2306.11695 , 2023

Original

2023

Earlier work this paper cites.

I. Timiryasov and J.-L. Tastet, “Baby llama: knowledge distillation from an ensemble of teachers trained on a small dataset with no performance penalty,” arXiv preprint arXiv:2308.02019 , 2023

Original

2023

Earlier work this paper cites.

Y. Gu, L. Dong, F. Wei, and M. Huang, “Minillm: Knowledge distillation of large language models,” arXiv preprint arXiv:2306.08543 , 2023

Original

2023

Cited alongside, same era.

C.-Y. Hsieh, C.-L. Li, C.-K. Yeh, H. Nakhost, Y. Fujii, A. Ratner, R. Krishna, C.-Y. Lee, and T. Pfister, “Distilling step-by-step! outperforming larger language models with less training data and smaller model sizes,” arXiv preprint arXiv:2305.02301 , 2023

Original

2023

Cited alongside, same era.

Y. Bai, H. Zhou, K. Zhao, J. Chen, J. Yu, and K. Wang, “Transformer-opu: An fpga-based overlay processor for transformer networks,” in 2023 IEEE 31st Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM) . IEEE, 2023, pp. 221–221

2023

Cited alongside, same era.

Y. Sheng, L. Zheng, B. Yuan, Z. Li, M. Ryabinin, B. Chen, P. Liang, C. Ré, I. Stoica, and C. Zhang, “Flexgen: High-throughput generative inference of large language models with a single gpu,” in International Conference on Machine Learning . PMLR, 2023, pp. 31 094–31 116

M. Hassanin and N. Moustafa, “A comprehensive overview of large language models (llms) for cyber defences: Opportunities and directions,” arXiv preprint arXiv:2405.14487 , 2024

Original

2024

Later among the works it cites.

S. Xu, X. Zhang, and L. Qin, “Eduagent: Generative student agents in learning,” arXiv preprint arXiv:2404.07963 , 2024

Original

2024

Later among the works it cites.

H. Jin, M. Yoo, J. Park, Y. Lee, X. Wang, and J. Kim, “Teachtune: Reviewing pedagogical agents against diverse student profiles with simulated students,” arXiv preprint arXiv:2410.04078 , 2024

Original

2024

Later among the works it cites.

K. Yang, Y. Chu, T. Darwin, A. Han, H. Li, H. Wen, Y. Copur-Gencturk, J. Tang, and H. Liu, “Content knowledge identification with multi-agent large language models (llms),” in International Conference on Artificial Intelligence in Education . Springer, 2024, pp. 284–292

2024

Later among the works it cites.