HumanEval on Latest GPT Models -- 2024

Attention is all you need

Ashish Vaswani et al · 2017

Earlier work this paper cites.

Evaluating large language models trained on code, 2021

Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N. Carr, Jan Leike, Josh Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, and Wojciech Zaremba · 2021

Earlier work this paper cites.

arXiv preprint arXiv:2303.06018

Original

Hierarchical neural program synthesis · 2023

Earlier work this paper cites.

arXiv preprint arXiv:2303.03004

Original

xcodeeval: A large scale multilingual multitask benchmark for code understanding, generation, translation and retrieval · 2023

Earlier work this paper cites.

Assessing gpt-4’s role as a co-collaborator in scientific research: A case study analyzing einstein’s special theory of relativity

Steven Bryant · 2023

Earlier work this paper cites.

Reasoning with language model is planning with world model, 2023

Shibo Hao, Yi Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, and Zhiting Hu · 2023

Cited alongside, same era.

Iaso: Enhancing syntax error correction using deep learning techniques

David C. S. Li and Weng-Fai Wong · 2023

Cited alongside, same era.

Gpt-4 technical report, 2023

OpenAI · 2023

Cited alongside, same era.

Reflexion: Language agents with verbal reinforcement learning, 2023

Noah Shinn, Federico Cassano, Edward Berman, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao · 2023

Cited alongside, same era.

Enhancing robot program synthesis through environmental context

Author Unknown · 2023

Cited alongside, same era.

Six-tier architecture for ai-generated software development: A large language models approach

Waqas Uzair · 2023

Later among the works it cites.

Can chatgpt write a good boolean query for systematic review literature search?

Shuai Wang, Harrisen Scells, Bevan Koopman, and Guido Zuccon · 2023

Later among the works it cites.

Chain-of-thought prompting elicits reasoning in large language models, 2023

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, and Denny Zhou · 2023

Later among the works it cites.

Tree of thoughts: Deliberate problem solving with large language models, 2023

Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, and Karthik Narasimhan · 2023

Later among the works it cites.

Language agent tree search unifies reasoning acting and planning in language models, 2023

Andy Zhou, Kai Yan, Michal Shlapentokh-Rothman, Haohan Wang, and Yu-Xiong Wang · 2023

Later among the works it cites.