A Quantitative and Qualitative Evaluation of LLM-Based Explainable Fault Localization

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, and Prafulla et al. Dhariwal. 2020 · 1901

Earlier work this paper cites.

Automatic repair of real bugs in java: A large-scale experiment on the defects4j dataset

Matias Martinez, Thomas Durieux, Romain Sommerard, Jifeng Xuan, and Martin Monperrus. 2017 · 1964

Earlier work this paper cites.

Fault localization using execution slices and dataflow tests. In Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE’95 . 143–151

H. Agrawal, J.R. Horgan, S. London, and W.E. Wong. 1995 · 1995

Earlier work this paper cites.

Efficient use of code coverage in large-scale software development. In Proceedings of the 2003 conference of the Centre for Advanced Studies on Collaborative research . 145–155

Yong Woo Kim. 2003 · 2003

Earlier work this paper cites.

On the Accuracy of Spectrum-based Fault Localization. In Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION (TAICPART-MUTATION 2007) . 89–98

Rui Abreu, Peter Zoeteweij, and Arjan J.C. van Gemund. 2007 · 2007

Earlier work this paper cites.

Are Automated Debugging Techniques Actually Helping Programmers?. In Proceedings of the 2011 International Symposium on Software Testing and Analysis (Toronto, Ontario, Canada) (ISSTA ’11) . Association for Computing Machinery, New York, NY, USA, 199–209

Chris Parnin and Alessandro Orso. 2011 · 2011

Earlier work this paper cites.

Statistical methods for rates and proportions

Joseph L Fleiss, Bruce Levin, and Myunghee Cho Paik. 2013 · 2013

Earlier work this paper cites.

The DStar Method for Effective Software Fault Localization

W. Eric Wong, Vidroha Debroy, Ruizhi Gao, and Yihao Li. 2014 · 2013

Earlier work this paper cites.

Defects4J: A Database of Existing Faults to Enable Controlled Testing Studies for Java Programs. In Proceedings of the 2014 International Symposium on Software Testing and Analysis (San Jose, CA, USA) (ISSTA 2014) . Association for Computing Machinery, New York, NY, USA, 437–440

René Just, Darioush Jalali, and Michael D. Ernst. 2014 · 2014

Earlier work this paper cites.

Ask the Mutants: Mutating Faulty Programs for Fault Localization. In 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation . 153–162

Seokhyeon Moon, Yunho Kim, Moonzoo Kim, and Shin Yoo. 2014 · 2014

Earlier work this paper cites.

Test case purification for improving fault localization. In Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering (Hong Kong, China) (FSE 2014) . Association for Computing Machinery, New York, NY, USA, 52–63

Jifeng Xuan and Martin Monperrus. 2014 · 2014

Earlier work this paper cites.

A Practical Guide to Controlled Experiments of Software Engineering Tools with Human Participants

Amy J. Ko, Thomas D. LaToza, and Margaret M. Burnett. 2015 · 2015

Earlier work this paper cites.

Metallaxis-FL: Mutation-Based Fault Localization

Mike Papadakis and Yves Le Traon. 2015 · 2015

Earlier work this paper cites.

Practitioners’ Expectations on Automated Fault Localization. In Proceedings of the 25th International Symposium on Software Testing and Analysis (Saarbrücken, Germany) (ISSTA 2016) . Association for Computing Machinery, New York, NY, USA, 165–176

Pavneet Singh Kochhar, Xin Xia, David Lo, and Shanping Li. 2016 · 2016

Earlier work this paper cites.

A Survey on Software Fault Localization

W. Eric Wong, Ruizhi Gao, Yihao Li, Rui Abreu, and Franz Wotawa. 2016 · 2016

Earlier work this paper cites.

“Automated Debugging Considered Harmful” Considered Harmful: A User Study Revisiting the Usefulness of Spectra-Based Fault Localization Techniques with Professionals Using Real Bugs from Large Systems. In 2016 IEEE International Conference on Software Maintenance and Evolution (ICSME) . 267–278

Xin Xia, Lingfeng Bao, David Lo, and Shanping Li. 2016 · 2016

Earlier work this paper cites.

Where is the Bug and How is It Fixed? An Experiment with Practitioners. In Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering (Paderborn, Germany) (ESEC/FSE 2017) . Association for Computing Machinery, New York, NY, USA, 117–128

Marcel Böhme, Ezekiel O. Soremekun, Sudipta Chattopadhyay, Emamurho Ugherughe, and Andreas Zeller. 2017 · 2017

Earlier work this paper cites.

Code coverage at Google. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering . 955–963

Marko Ivankovic, Goran Petrovic, René Just, and Gordon Fraser. 2019 · 2019

Cited alongside, same era.

DeepFL: Integrating Multiple Fault Diagnosis Dimensions for Deep Fault Localization. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis (Beijing, China) (ISSTA 2019) . Association for Computing Machinery, New York, NY, USA, 169–180

Xia Li, Wei Li, Yuqun Zhang, and Lingming Zhang. 2019 · 2019

Cited alongside, same era.

SapFix: Automated End-to-End Repair at Scale. In 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) . 269–278

Alexandru Marginean, Johannes Bader, Satish Chandra, Mark Harman, Yue Jia, Ke Mao, Alexander Mols, and Andrew Scott. 2019 · 2019

Cited alongside, same era.

An empirical study of fault localization families and their combinations

Daming Zou, Jingjing Liang, Yingfei Xiong, Michael D. Ernst, and Lu Zhang. 2019 · 2019

Fault Localization via Efficient Probabilistic Modeling of Program Semantics. In Proceedings of the 44th International Conference on Software Engineering (Pittsburgh, Pennsylvania) (ICSE ’22) . Association for Computing Machinery, New York, NY, USA, 958–969

Muhan Zeng, Yiqian Wu, Zhentao Ye, Yingfei Xiong, Xin Zhang, and Lu Zhang. 2022 · 2022

Later among the works it cites.

Reproducing and Improving the BugsInPy Dataset. In 2023 IEEE 23rd International Working Conference on Source Code Analysis and Manipulation (SCAM) . IEEE, 260–264

Faustino Aguilar, Samuel Grayson, and Darko Marinov. 2023 · 2023

Closest in time.

KG4CraSolver: Recommending Crash Solutions via Knowledge Graph. In Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’23) . ACM

Xueying Du, Yiling Lou, Mingwei Liu, Xin Peng, and Tianyong Yang. 2023 · 2023

Closest in time.

Impact of Code Language Models on Automated Program Repair. In Proceedings of the 45th International Conference on Software Engineering (Melbourne, Victoria, Australia) (ICSE ’23) . IEEE Press, 1430–1442