MegaAgent: A Large-Scale Autonomous LLM-based Multi-Agent System Without Predefined SOPs

Dryad: Distributed data-parallel programs from sequential building blocks

Michael Isard, Mihai Budiu, Yuan Yu, Andrew Birrell, and Dennis Fetterly. 2007 · 2007

Earlier work this paper cites.

Tensorflow-serving: Flexible, high-performance ml serving

Original

Christopher Olston, Noah Fiedel, Kiril Gorovoy, Jeremiah Harmsen, Li Lao, Fangwei Li, Vinu Rajashekhar, Sukriti Ramesh, and Jordan Soyke. 2017 · 2017

Earlier work this paper cites.

Batch: machine learning inference serving on serverless platforms with adaptive batching

Ahsan Ali, Riccardo Pinciroli, Feng Yan, and Evgenia Smirni. 2020 · 2020

Earlier work this paper cites.

Serving dnns like clockwork: Performance predictability from the bottom up

Arpan Gujarati, Reza Karimi, Safya Alzayat, Wei Hao, Antoine Kaufmann, Ymir Vigfusson, and Jonathan Mace. 2020 · 2020

Earlier work this paper cites.

Program synthesis with large language models

Original

Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie Cai, Michael Terry, Quoc Le, and 1 others. 2021 · 2021

Earlier work this paper cites.

Evaluating large language models trained on code

Original

Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, and 1 others. 2021 · 2021

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, and 1 others. 2021 · 2021

Earlier work this paper cites.

Measuring mathematical problem solving with the math dataset

Original

Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. 2021 · 2021

Earlier work this paper cites.

Machine translation decoding beyond beam search

Rémi Leblond, Jean-Baptiste Alayrac, L. Sifre, Miruna Pislar, Jean-Baptiste Lespiau, Ioannis Antonoglou, K. Simonyan, and O. Vinyals. 2021 · 2021

Earlier work this paper cites.

SONIC: Application-aware data passing for chained serverless applications

Ashraf Mahgoub, Karthick Shankar, Subrata Mitra, Ana Klimovic, Somali Chaterji, and Saurabh Bagchi. 2021 · 2021

Earlier work this paper cites.

Qmsum: A new benchmark for query-based multi-domain meeting summarization

Original

Ming Zhong, Da Yin, Tao Yu, Ahmad Zaidi, Mutethia Mutuma, Rahul Jha, Ahmed Hassan Awadallah, Asli Celikyilmaz, Yang Liu, Xipeng Qiu, and 1 others. 2021 · 2021

Earlier work this paper cites.

Chatgpt

OpenAI. 2022 · 2022

Earlier work this paper cites.

Self-consistency improves chain of thought reasoning in language models

Original

Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2022 · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, and 1 others. 2022 · 2022

Earlier work this paper cites.

React: Synergizing reasoning and acting in language models

Shunyu Yao, Jeffrey Zhao, Dian Yu, Izhak Shafran, Karthik R Narasimhan, and Yuan Cao. 2022 · 2022

Earlier work this paper cites.

Orca: A distributed serving system for Transformer-Based generative models

Gyeong-In Yu, Joo Seong Jeong, Geon-Woo Kim, Soojeong Kim, and Byung-Gon Chun. 2022 · 2022

Earlier work this paper cites.

Huggingface text generation inference

2023 · 2023

Earlier work this paper cites.

Promptflow

2023 · 2023

Earlier work this paper cites.

Tensorrt-llm: A tensorrt toolbox for optimized large language model inference

2023 · 2023

Earlier work this paper cites.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, and 1 others. 2023 · 2023

Earlier work this paper cites.

Improving factuality and reasoning in language models through multiagent debate

Yilun Du, Shuang Li, Antonio Torralba, Joshua B Tenenbaum, and Igor Mordatch. 2023 · 2023

Earlier work this paper cites.

Memory matters: The need to improve long-term memory in llm-agents

Kostas Hatalis, Despina Christou, Joshua Myers, Steven Jones, Keith Lambert, Adam Amos-Binks, Zohreh Dannenhauer, and Dustin Dannenhauer. 2023 · 2023

Earlier work this paper cites.

Metagpt: Meta programming for multi-agent collaborative framework

Original

Sirui Hong, Xiawu Zheng, Jonathan Chen, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, and 1 others. 2023 · 2023

Earlier work this paper cites.

Bert4eth: A pre-trained transformer for ethereum fraud detection

Sihao Hu, Zhen Zhang, Bingqiao Luo, Shengliang Lu, Bingsheng He, and Ling Liu. 2023 · 2023

Earlier work this paper cites.

War and peace (waragent): Large language model-based multi-agent simulation of world wars

Original

Wenyue Hua, Lizhou Fan, Lingyao Li, Kai Mei, Jianchao Ji, Yingqiang Ge, Libby Hemphill, and Yongfeng Zhang. 2023 · 2023

Earlier work this paper cites.

Towards mitigating llm hallucination via self reflection

Ziwei Ji, Tiezheng Yu, Yan Xu, Nayeon Lee, Etsuko Ishii, and Pascale Fung. 2023 · 2023

Earlier work this paper cites.

Structgpt: A general framework for large language model to reason over structured data

Jinhao Jiang, Kun Zhou, Zican Dong, Keming Ye, Wayne Xin Zhao, and Ji-Rong Wen. 2023 · 2023

Earlier work this paper cites.

S 3 : Increasing gpu utilization during generative inference for higher throughput

Yunho Jin, Chun-Feng Wu, David Brooks, and Gu-Yeon Wei. 2023 · 2023

Earlier work this paper cites.

Encouraging divergent thinking in large language models through multi-agent debate

Original

Tian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang, Yan Wang, Rui Wang, Yujiu Yang, Shuming Shi, and Zhaopeng Tu. 2023 · 2023

Earlier work this paper cites.

Reasoning on graphs: Faithful and interpretable large language model reasoning

Original

Linhao Luo, Yuan-Fang Li, Gholamreza Haffari, and Shirui Pan. 2023 · 2023

Earlier work this paper cites.

When not to trust language models: Investigating effectiveness of parametric and non-parametric memories

Alex Mallen, Akari Asai, Victor Zhong, Rajarshi Das, Daniel Khashabi, and Hannaneh Hajishirzi. 2023 · 2023

Cited alongside, same era.

Gpt-4 technical report

Original

OpenAI. 2023 · 2023

Cited alongside, same era.

Generative agents: Interactive simulacra of human behavior

Joon Sung Park, Joseph O’Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. 2023 · 2023

Cited alongside, same era.

Efficiently scaling transformer inference

Reiner Pope, Sholto Douglas, Aakanksha Chowdhery, Jacob Devlin, James Bradbury, Jonathan Heek, Kefan Xiao, Shivani Agrawal, and Jeff Dean. 2023 · 2023

Cited alongside, same era.

Automatic prompt optimization with" gradient descent" and beam search

Original

Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, and Michael Zeng. 2023 · 2023

Simulating financial market via large language model based agents

Original

Shen Gao, Yuntao Wen, Minghang Zhu, Jianing Wei, Yuhan Cheng, Qunzi Zhang, and Shuo Shang. 2024 · 2024

Closest in time.

Large language model based multi-agents: A survey of progress and challenges

Original

Taicheng Guo, Xiuying Chen, Yaqi Wang, Ruidi Chang, Shichao Pei, Nitesh V Chawla, Olaf Wiest, and Xiangliang Zhang. 2024 · 2024

Closest in time.

Quantifying the uncertainty of llm hallucination spreading in complex adaptive social networks

Guozhi Hao, Jun Wu, Qianqian Pan, and Rosario Morello. 2024 · 2024

Closest in time.

MetaGPT: Meta programming for a multi-agent collaborative framework

Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu, and Jürgen Schmidhuber. 2024 · 2024

Closest in time.

An empirical study of llm-as-a-judge for llm evaluation: Fine-tuned judge models are task-specific classifiers