Divide, Optimize, Merge: Fine-Grained LLM Agent Optimization at Scale

Bagging predictors

Leo Breiman. 1996 · 1996

Earlier work this paper cites.

Language models are few-shot learners

Original

Tom B Brown. 2020 · 2005

Earlier work this paper cites.

Alfworld: Aligning text and embodied environments for interactive learning

Original

Mohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté, Yonatan Bisk, Adam Trischler, and Matthew Hausknecht. 2020 · 2010

Earlier work this paper cites.

What makes good in-context examples for gpt- 3 3 ?

Original

Jiachang Liu, Dinghan Shen, Yizhe Zhang, Bill Dolan, Lawrence Carin, and Weizhu Chen. 2021 · 2021

Earlier work this paper cites.

Fantastically ordered prompts and where to find them: Overcoming few-shot prompt order sensitivity

Original

Yao Lu, Max Bartolo, Alastair Moore, Sebastian Riedel, and Pontus Stenetorp. 2021 · 2021

Earlier work this paper cites.

Metaicl: Learning to learn in context

Original

Sewon Min, Mike Lewis, Luke Zettlemoyer, and Hannaneh Hajishirzi. 2021 · 2021

Earlier work this paper cites.

Calibrate before use: Improving few-shot performance of language models

Zihao Zhao, Eric Wallace, Shi Feng, Dan Klein, and Sameer Singh. 2021 · 2021

Earlier work this paper cites.

A survey on in-context learning

Original

Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng, Zhiyong Wu, Baobao Chang, Xu Sun, Jingjing Xu, and Zhifang Sui. 2022 · 2022

Earlier work this paper cites.

Grips: Gradient-free, edit-based instruction search for prompting large language models

Original

Archiki Prasad, Peter Hase, Xiang Zhou, and Mohit Bansal. 2022 · 2022

Earlier work this paper cites.

Selective annotation makes language models better few-shot learners

Original

Hongjin Su, Jungo Kasai, Chen Henry Wu, Weijia Shi, Tianlu Wang, Jiayi Xin, Rui Zhang, Mari Ostendorf, Luke Zettlemoyer, Noah A Smith, et al. 2022 · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022 · 2022

Earlier work this paper cites.

Self-adaptive in-context learning: An information compression perspective for in-context example selection and ordering

Original

Zhiyong Wu, Yaoxiang Wang, Jiacheng Ye, and Lingpeng Kong. 2022 · 2022

Earlier work this paper cites.

Large language models are human-level prompt engineers

Original

Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, Keiran Paster, Silviu Pitis, Harris Chan, and Jimmy Ba. 2022 · 2022

Earlier work this paper cites.

Large language models as tool makers

Original

Tianle Cai, Xuezhi Wang, Tengyu Ma, Xinyun Chen, and Denny Zhou. 2023 · 2023

Earlier work this paper cites.

Black-box prompt optimization: Aligning large language models without model training

Original

Jiale Cheng, Xiao Liu, Kehan Zheng, Pei Ke, Hongning Wang, Yuxiao Dong, Jie Tang, and Minlie Huang. 2023 · 2023

Earlier work this paper cites.

Swe-bench: Can language models resolve real-world github issues?

Original

Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan. 2023 · 2023

Earlier work this paper cites.

Dspy: Compiling declarative language model calls into self-improving pipelines

Original

Omar Khattab, Arnav Singhvi, Paridhi Maheshwari, Zhiyuan Zhang, Keshav Santhanam, Sri Vardhamanan, Saiful Haq, Ashutosh Sharma, Thomas T Joshi, Hanna Moazam, et al. 2023 · 2023

Earlier work this paper cites.

Gaia: a benchmark for general ai assistants

Original

Grégoire Mialon, Clémentine Fourrier, Craig Swift, Thomas Wolf, Yann LeCun, and Thomas Scialom. 2023 · 2023

Earlier work this paper cites.

Gpt-4 system card

OpenAI. 2023 · 2023

Cited alongside, same era.

Automatic prompt optimization with “gradient descent” and beam search

Reid Pryzant, Dan Iter, Jerry Li, Yin Lee, Chenguang Zhu, and Michael Zeng. 2023 · 2023

Cited alongside, same era.

Creator: Tool creation for disentangling abstract and concrete reasoning of large language models

Original

Cheng Qian, Chi Han, Yi R Fung, Yujia Qin, Zhiyuan Liu, and Heng Ji. 2023 · 2023

Cited alongside, same era.

ReAct: Synergizing reasoning and acting in language models

Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2023 · 2023

Cited alongside, same era.

Craft: Customizing llms by creating and retrieving from specialized toolsets

Original

Lifan Yuan, Yangyi Chen, Xingyao Wang, Yi R Fung, Hao Peng, and Heng Ji. 2023 · 2023

Cited alongside, same era.

Self-refine: Iterative refinement with self-feedback

Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, et al. 2024 · 2024

Later among the works it cites.

X L 2 \text{L}^{2} bench: A benchmark for extremely long context understanding with long-range dependencies

Original

Xuanfan Ni, Hengyi Cai, Xiaochi Wei, Shuaiqiang Wang, Dawei Yin, and Piji Li. 2024 · 2024

Later among the works it cites.

Optimizing instructions and demonstrations for multi-stage language model programs

Krista Opsahl-Ong, Michael J Ryan, Josh Purtell, David Broman, Christopher Potts, Matei Zaharia, and Omar Khattab. 2024 · 2024

Later among the works it cites.

Training software engineering agents and verifiers with swe-gym

Original

Jiayi Pan, Xingyao Wang, Graham Neubig, Navdeep Jaitly, Heng Ji, Alane Suhr, and Yizhe Zhang. 2024 · 2024

Later among the works it cites.

On context utilization in summarization with large language models