Fetching the paper…

Reading the bibliography…

2024

Focused ReAct: Improving ReAct through Reiterate and Early Stop

Li, Shuoqiu, Xu, Han, Chen, Haipeng

Original
PDF
Post on X

Understand

Large language models (LLMs) have significantly improved their reasoning and decision-making capabilities, as seen in methods like ReAct.

However, despite its effectiveness in tackling complex tasks, ReAct faces two main challenges: losing focus on the original question and becoming stuck in action loops.
To address these issues, we introduce Focused ReAct, an enhanced version of the ReAct paradigm that incorporates reiteration and early stop mechanisms.
These improvements help the model stay focused on the original query and avoid repetitive behaviors.

Focused ReAct: Improving ReAct through Reiterate and Early Stop · Around

Built on

HotpotQA: A dataset for diverse, explainable multi-hop question answering
Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William Cohen, Ruslan Salakhutdinov, and Christopher D Manning. 2018 · 2018
Earlier work this paper cites.
React: Synergizing reasoning and acting in language models
Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik R Narasimhan, and Yuan Cao. 2023 · 2023
Earlier work this paper cites.
Phi-3 technical report: A highly capable language model locally on your phone
Original
Marah Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, et al. 2024 · 2024
Earlier work this paper cites.

Similar

The llama 3 herd of models
Original
Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, et al. 2024 · 2024
Cited alongside, same era.
Gemma 2: Improving open language models at a practical size
Original
Gemma Team, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, Léonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ramé, et al. 2024 · 2024
Cited alongside, same era.

Then

A survey on large language model based autonomous agents
Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, et al. 2024 · 2024
Closest in time.
Can speculative sampling accelerate react without compromising reasoning quality?
Han Xu, Jingyang Ye, Yutong Li, and Haipeng Chen. 2024 · 2024
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…