Fetching the paper…
Reading the bibliography…
Planning is a crucial element of both human intelligence and contemporary large language models (LLMs).
Improving language understanding by generative pre-training
A. Radford, K. Narasimhan, T. Salimans, I. Sutskever, et al · 2018
Earlier work this paper cites.
Language models as zero-shot planners: Extracting actionable knowledge for embodied agents
W. Huang, P. Abbeel, D. Pathak, and I. Mordatch · 2022
Earlier work this paper cites.
How to build a cognitive map: insights from models of the hippocampal formation
J. C. Whittington, D. McCaffary, J. J. Bakermans, and T. E. Behrens · 2022
Earlier work this paper cites.
Unveiling Transformers with LEGO: a synthetic reasoning task
Y. Zhang, A. Backurs, S. Bubeck, R. Eldan, S. Gunasekar, and T. Wagner · 2022
Earlier work this paper cites.
GPT-4 technical report
O. J. Achiam, S. Adler, and et al · 2023
Earlier work this paper cites.
Physics of language models: Part 1, context-free grammar
Z. Allen-Zhu and Y. Li · 2023
Earlier work this paper cites.
Physics of language models: Part 3.1, knowledge storage and extraction
Z. Allen-Zhu and Y. Li · 2023
Earlier work this paper cites.
Physics of language models: Part 3.2, knowledge manipulation
Z. Allen-Zhu and Y. Li · 2023
Earlier work this paper cites.
GraphLLM: Boosting graph reasoning ability of large language model
Z. Chai, T. Zhang, L. Wu, K. Han, X. Hu, X. Huang, and Y. Yang · 2023
Earlier work this paper cites.
Towards revealing the mystery behind chain of thought: a theoretical perspective
G. Feng, B. Zhang, Y. Gu, H. Ye, D. He, and L. Wang · 2023
Earlier work this paper cites.
Looped transformers as programmable computers
A. Giannou, S. Rajput, J.-y. Sohn, K. Lee, J. D. Lee, and D. Papailiopoulos · 2023
Earlier work this paper cites.
J. Guo, L. Du, and H. Liu · 2023
Cited alongside, same era.
Teaching arithmetic to small transformers
N. Lee, K. Sreenivasan, J. D. Lee, K. Lee, and D. Papailiopoulos · 2023
Cited alongside, same era.
ControlLLM: Augment language models with tools by searching on graphs
Z. Liu, Z. Lai, Z. Gao, E. Cui, Z. Li, X. Zhu, L. Lu, Q. Chen, Y. Qiao, J. Dai, et al · 2023
Cited alongside, same era.
The parallelism tradeoff: Limitations of log-precision transformers
W. Merrill and A. Sabharwal · 2023
Cited alongside, same era.
Evaluating cognitive maps and planning in large language models with CogEval
I. Momennejad, H. Hasanbeig, F. Vieira Frujeri, H. Sharma, N. Jojic, H. Palangi, R. Ness, and J. Larson · 2023
Trained transformers learn linear models in-context
R. Zhang, S. Frei, and P. L. Bartlett · 2023
Later among the works it cites.
Physics of language models: Part 3.3, knowledge capacity scaling laws
Z. Allen-Zhu and Y. Li · 2024
Closest in time.
ToolNet: Connecting large language models with massive tools via tool graph
X. Liu, Z. Peng, X. Yi, X. Xie, L. Xiang, Y. Liu, and D. Xu · 2024
Closest in time.
Graphinstruct: Empowering large language models with graph understanding and reasoning capability
Z. Luo, X. Song, H. Huang, J. Lian, C. Zhang, J. Jiang, X. Xie, and H. Jin · 2024
Closest in time.
Reflexion: Language agents with verbal reinforcement learning
N. Shinn, F. Cassano, A. Gopinath, K. Narasimhan, and S. Yao · 2024
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
HuggingGPT: Solving AI tasks with ChatGPT and its friends in Huggingface
Y. Shen, K. Song, X. Tan, D. Li, W. Lu, and Y. Zhuang · 2023
Cited alongside, same era.
GraphGPT: Graph instruction tuning for large language models
J. Tang, Y. Yang, W. Wei, L. Shi, L. Su, S. Cheng, D. Yin, and C. Huang · 2023
Cited alongside, same era.
On the planning abilities of large language models-a critical investigation
K. Valmeekam, M. Marquez, S. Sreedharan, and S. Kambhampati · 2023
Cited alongside, same era.
Voyager: An open-ended embodied agent with large language models
G. Wang, Y. Xie, Y. Jiang, A. Mandlekar, C. Xiao, Y. Zhu, L. Fan, and A. Anandkumar · 2023
Cited alongside, same era.
Can language models solve graph problems in natural language?
H. Wang, S. Feng, T. He, Z. Tan, X. Han, and Y. Tsvetkov · 2023
Cited alongside, same era.
Closest in time.
Solving Olympiad geometry without human demonstrations
T. H. Trinh, Y. Wu, Q. V. Le, H. He, and T. Luong · 2024
Closest in time.
A survey on large language model based autonomous agents
L. Wang, C. Ma, X. Feng, Z. Zhang, H. Yang, J. Zhang, Z. Chen, J. Tang, X. Chen, Y. Lin, et al · 2024
Closest in time.
Do efficient transformers really save computation?
K. Yang, J. Ackermann, Z. He, G. Feng, B. Zhang, Y. Feng, Q. Ye, D. He, and L. Wang · 2024
Closest in time.
Physics of language models: Part 2.1, grade-school math and the hidden reasoning process
T. Ye, Z. Xu, Y. Li, and Z. Allen-Zhu · 2024
Closest in time.
Physics of language models: Part 2.2, how to learn from mistakes on grade-school math problems
T. Ye, Z. Xu, Y. Li, and Z. Allen-Zhu · 2024
Closest in time.