Towards Effective GenAI Multi-Agent Collaboration: Design and Evaluation for Enterprise Applications

Multiagent systems

Munindar P Singh · 1994

Earlier work this paper cites.

Multiagent systems

Katia P Sycara · 1998

Earlier work this paper cites.

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei · 2020

Earlier work this paper cites.

Agentverse: Facilitating multi-agent collaboration and exploring emergent behaviors in agents

Original

Weize Chen, Yusheng Su, Jingwei Zuo, Cheng Yang, Chenfei Yuan, Chen Qian, Chi-Min Chan, Yujia Qin, Yaxi Lu, Ruobing Xie, et al · 2023

Earlier work this paper cites.

Camel: Communicative agents for "mind" exploration of large language model society

Guohao Li, Hasan Abed Al Kader Hammoud, Hani Itani, Dmitrii Khizbullin, and Bernard Ghanem · 2023

Earlier work this paper cites.

Theory of mind for multi-agent collaboration via large language models

Huao Li, Yu Chong, Simon Stepputtis, Joseph Campbell, Dana Hughes, Charles Lewis, and Katia Sycara · 2023

Earlier work this paper cites.

Generative agents: Interactive simulacra of human behavior

Joon Sung Park, Joseph C. O’Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein · 2023

Earlier work this paper cites.

Multi-agent collaboration: Harnessing the power of intelligent llm agents

Original

Yashar Talebirad and Amirhossein Nadiri · 2023

Earlier work this paper cites.

ReAct: Synergizing reasoning and acting in language models

Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao · 2023

Earlier work this paper cites.

Claude 3.5 Sonnet, 2024

Anthropic · 2024

Cited alongside, same era.

Assessing and verifying task utility in LLM-powered applications

Negar Arabzadeh, Siqing Huo, Nikhil Mehta, Qingyun Wu, Chi Wang, Ahmed Hassan Awadallah, Charles L. A. Clarke, and Julia Kiseleva · 2024

Cited alongside, same era.

CrewAI, 2024

CrewAI · 2024

Cited alongside, same era.

AgentQuest: A modular benchmark framework to measure progress and improve LLM agents

Luca Gioacchini, Giuseppe Siracusano, Davide Sanvito, Kiril Gashteovski, David Friede, Roberto Bifulco, and Carolin Lawrence · 2024

Cited alongside, same era.

Large language model based multi-agents: A survey of progress and challenges

Original

Taicheng Guo, Xiuying Chen, Yaqi Wang, Ruidi Chang, Shichao Pei, Nitesh V Chawla, Olaf Wiest, and Xiangliang Zhang · 2024

Cited alongside, same era.

Llm multi-agent systems: Challenges and open problems

LangGraph, 2024

LangChain · 2024

Closest in time.

Toolsandbox: A stateful, conversational, interactive evaluation benchmark for llm tool use capabilities

Original

Jiarui Lu, Thomas Holleis, Yizhe Zhang, Bernhard Aumayer, Feng Nan, Felix Bai, Shuang Ma, Shen Ma, Mengyu Li, Guoli Yin, et al · 2024

Closest in time.

Hello GPT-4o, 2024

OpenAI · 2024

Closest in time.

ChatDev: Communicative agents for software development

Chen Qian, Wei Liu, Hongzhang Liu, Nuo Chen, Yufan Dang, Jiahao Li, Cheng Yang, Weize Chen, Yusheng Su, Xin Cong, Juyuan Xu, Dahai Li, Zhiyuan Liu, and Maosong Sun · 2024

Closest in time.

Should we be going mad? a look at multi-agent debate strategies for llms

Andries Petrus Smit, Nathan Grinsztajn, Paul Duckworth, Thomas D Barrett, and Arnu Pretorius · 2024

Closest in time.

AutoGen: Enabling next-gen llm applications via multi-agent conversation framework