MoA is All You Need: Building LLM Research Team using Mixture of Agents

J. Hoffmann, S. Borgeaud, A. Mensch, E. Buchatskaya, T. Cai, E. Rutherford, D. De, L. Casas, L. Hendricks, J. Welbl, A. Clark, T. Hennigan, E. Noland, K. Millican, G. Van Den Driessche, B. Damoc, A. Guy, S. Osindero, K. Simonyan, E. Elsen, J. Rae, O. Vinyals, L. Sifre, and â. Equal, “Training compute-optimal large language models,” 03 2022

2022

Earlier work this paper cites.

A. Zeng, M. Attarian, B. Ichter, K. Choromanski, A. Wong, S. Welker, F. Tombari, A. Purohit, M. Ryoo, V. Sindhwani, J. Lee, V. Vanhoucke, and P. Google, “Socratic models: Composing zero-shot multimodal reasoning with language,” 05 2022

2022

Earlier work this paper cites.

G. Cheng, “Unlocking the power of multiple language models: A dive into collaborative ai,” 11 2023

2023

Earlier work this paper cites.

R. Gordon, “Multi-ai collaboration helps reasoning and factual accuracy in large language models,” 09 2023

2023

Earlier work this paper cites.

Y.-S. Chuang, A. Goyal, N. Harlalka, S. Suresh, R. Hawkins, S. Yang, D. Shah, J. Hu, and T. T. Rogers, “Simulating opinion dynamics with networks of llm-based agents,” 11 2023

2023

Earlier work this paper cites.

N. F. Liu, K. Lin, J. Hewitt, A. Paranjape, M. Bevilacqua, F. Petroni, and P. Liang, “Lost in the middle: How language models use long contexts,” arXiv

2023

Cited alongside, same era.

S. Z. Shen, H. Lang, B. Wang, Y. Kim, and D. Sontag, “Learning to decode collaboratively with multiple language models,” 03 2024

2024

Cited alongside, same era.

J. Li, Q. Zhang, Y. Yu, Q. Fu, and D. Ye, “More agents is all you need,” arXiv (Cornell University)

2024

Cited alongside, same era.

T. Guo, X. Chen, Y. Wang, R. Chang, S. Pei, N. V. Chawla, O. Wiest, and X. Zhang, “Large language model based multi-agents: A survey of progress and challenges,” 01 2024

2024

Cited alongside, same era.

“Introduction — ��️�� langchain,”

Cited in the paper.

A. Q. Jiang, A. Sablayrolles, A. Roux, A. Mensch, B. Savary, C. Bamford, D. S. Chaplot, D. d. l. Casas, E. B. Hanna, F. Bressand, G. Lengyel, G. Bour, G. Lample, L. R. Lavaud, L. Saulnier, M.-A. Lachaux, P. Stock, S. Subramanian, S. Yang, S. Antoniak, T. L. Scao, T. Gervet, T. Lavril, T. Wang, T. Lacroix, and W. E. Sayed, “Mixtral of experts,” 01 2024

2024

Closest in time.

M. Josifoski, L. Klein, M. Peyrard, N. Baldwin, Y. Li, S. Geng, J. P. Schnitzler, Y. Yao, J. Wei, D. Paul, and R. West, “Flows: Building blocks of reasoning and collaborating ai,” 02 2024

2024

Closest in time.

Y. Ding, A. Poudel, Q. Zeng, T. Weninger, B. Veeramani, and S. Bhattacharya, “Entgpt: Linking generative large language models with knowledge bases,” 02 2024

2024

Closest in time.

J. Wang, J. Wang, B. Together, C. Zhang, and J. Zou, “Mixture-of-agents enhances large language model capabilities,” 06 2024

2024

Closest in time.