Fetching the paper…
Reading the bibliography…
Rigorous software testing is crucial for developing and maintaining high-quality code, making automated test generation a promising avenue for both improving software quality and boosting the effectiveness of code generation methods.
Phase distribution of software development effort
Ye Yang, Mei He, Mingshu Li, Qing Wang, and Barry W. Boehm · 2008
Earlier work this paper cites.
The probabilistic relevance framework: BM25 and beyond
Stephen E. Robertson and Hugo Zaragoza · 2009
Earlier work this paper cites.
Defects4j: a database of existing faults to enable controlled testing studies for java programs
René Just, Darioush Jalali, and Michael D. Ernst · 2014
Earlier work this paper cites.
Quixbugs: a multi-lingual program repair benchmark set based on the quixey challenge
Derrick Lin, James Koppel, Angela Chen, and Armando Solar-Lezama · 2017
Earlier work this paper cites.
Unit test case generation with transformers
Michele Tufano, Dawn Drain, Alexey Svyatkovskiy, Shao Kun Deng, and Neel Sundaresan · 2020
Earlier work this paper cites.
Program synthesis with large language models
Jacob Austin, Augustus Odena, Maxwell I. Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie J. Cai, Michael Terry, Quoc V. Le, and Charles Sutton · 2021
Earlier work this paper cites.
Evaluating large language models trained on code
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Pondé de Oliveira Pinto, Jared Kaplan, Harrison Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N. Carr, Jan Leike, Joshua Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, and Wojciech Zaremba · 2021
Earlier work this paper cites.
Measuring coding challenge competence with APPS
Dan Hendrycks, Steven Basart, Saurav Kadavath, Mantas Mazeika, Akul Arora, Ethan Guo, Collin Burns, Samir Puranik, Horace He, Dawn Song, and Jacob Steinhardt · 2021
Earlier work this paper cites.
Competition-level code generation with alphacode
Yujia Li, David Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, Thomas Hubert, Peter Choy, Cyprien de Masson d’Autume, Igor Babuschkin, Xinyun Chen, Po-Sen Huang, Johannes Welbl, Sven Gowal, Alexey Cherepanov, James Molloy, Daniel J. Mankowitz, Esme Sutherland Robson, Pushmeet Kohli, Nando de Freitas, Koray Kavukcuoglu, and Oriol Vinyals · 2022
Earlier work this paper cites.
Pynguin: Automated unit test generation for python
Stephan Lukasczyk and Gordon Fraser · 2022
Earlier work this paper cites.
Introducing Claude, Mar 2023
Anthropic · 2023
Cited alongside, same era.
Swe-bench: Can language models resolve real-world github issues?
Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan · 2023
Cited alongside, same era.
Large language models are few-shot testers: Exploring llm-based general bug reproduction
Sungmin Kang, Juyeon Yoon, and Shin Yoo · 2023
Cited alongside, same era.
Nuances are the key: Unlocking chatgpt to find failure-inducing tests with differential prompting
Tsz On Li, Wenxi Zong, Yibo Wang, Haoye Tian, Ying Wang, Shing-Chi Cheung, and Jeff Kramer · 2023
Cited alongside, same era.
OpenAI · 2023
Cited alongside, same era.
R2e: Turning any github repository into a programming agent test environment
Naman Jain, Manish Shetty, Tianjun Zhang, King Han, Koushik Sen, and Ion Stoica · 2024
Closest in time.
LLM-powered test case generation for detecting tricky bugs
Sungmin Kang, Juyeon Yoon, and Shin Yoo · 2024
Closest in time.
GPT-4o mini: advancing cost-efficient intelligence, Jul 2024
OpenAI · 2024
Closest in time.
Opendevin: Code less, make more, 2024
OpenDevin · 2024
Closest in time.
Pypl popularity of programming language index, Aug 2024
PYPL · 2024
Closest in time.
MAGIS: llm-based multi-agent framework for github issue resolution
Wei Tao, Yucheng Zhou, Wenqiang Zhang, and Yu Cheng · 2024
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
An empirical evaluation of using large language models for automated unit test generation
Max Schäfer, Sarah Nadi, Aryaz Eghbali, and Frank Tip · 2023
Cited alongside, same era.
A survey on what developers think about testing
Philipp Straubinger and Gordon Fraser · 2023
Cited alongside, same era.
Together AI API, 2023
TogetherAI · 2023
Cited alongside, same era.
Aider is SOTA for both SWE Bench and SWE Bench Lite, Jun 2024
Aider · 2024
Cited alongside, same era.
Introducing Claude 3.5 Sonnet, Jun 2024
Anthropic · 2024
Cited alongside, same era.
Automated unit test improvement using large language models at meta
Nadia Alshahwan, Jubin Chheda, Anastasia Finegenova, Beliz Gokkaya, Mark Harman, Inna Harper, Alexandru Marginean, Shubho Sengupta, and Eddy Wang
Cited in the paper.
Automated unit test improvement using large language models at meta
Nadia Alshahwan, Jubin Chheda, Anastasia Finegenova, Beliz Gokkaya, Mark Harman, Inna Harper, Alexandru Marginean, Shubho Sengupta, and Eddy Wang
Cited in the paper.
Closest in time.
Tiobe index for august 2024, Aug 2024
TIOBE · 2024
Closest in time.
A survey on large language model based autonomous agents
Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, Wayne Xin Zhao, Zhewei Wei, and Jirong Wen · 2024
Closest in time.
SWE-agent: Agent Computer Interfaces Enable Software Engineering Language Models, 2024
John Yang, Carlos E. Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, and Ofir Press · 2024
Closest in time.
Autocoderover: Autonomous program improvement
Yuntong Zhang, Haifeng Ruan, Zhiyu Fan, and Abhik Roychoudhury · 2024
Closest in time.