Beyond ChatGPT: Enhancing Software Quality Assurance Tasks with Diverse LLMs and Validation Techniques

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 1901

Earlier work this paper cites.

Software quality assurance-concepts and misconceptions. In Proceedings. 24th EUROMICRO Conference (Cat. No. 98EX204) , Vol. 2. IEEE, 853–859

Per Runeson and Peter Isacsson. 1998 · 1998

Earlier work this paper cites.

An evaluation of similarity coefficients for software fault localization. In 2006 12th Pacific Rim International Symposium on Dependable Computing (PRDC’06) . IEEE

Rui Abreu, Peter Zoeteweij, and Arjan JC Van Gemund. 2006 · 2006

Earlier work this paper cites.

Integrating static and dynamic analysis for detecting vulnerabilities. In 30th Annual International Computer Software and Applications Conference (COMPSAC’06) , Vol. 1. IEEE, 343–350

Ashish Aggarwal and Pankaj Jalote. 2006 · 2006

Earlier work this paper cites.

Automated code review tools for security

Gary McGraw. 2008 · 2008

Earlier work this paper cites.

Spectrum-based multiple fault localization. In 2009 IEEE/ACM International Conference on Automated Software Engineering . IEEE

Rui Abreu, Peter Zoeteweij, and Arjan JC Van Gemund. 2009 · 2009

Earlier work this paper cites.

On the influence of multiple faults on coverage-based fault localization. In Proceedings of the 2011 international symposium on software testing and analysis . 210–220

Nicholas DiGiuseppe and James A Jones. 2011 · 2011

Earlier work this paper cites.

A model for spectra-based software diagnosis

Lee Naish, Hua Jie Lee, and Kotagiri Ramamohanarao. 2011 · 2011

Earlier work this paper cites.

Mitigating program security vulnerabilities: Approaches and challenges

Hossain Shahriar and Mohammad Zulkernine. 2012 · 2012

Earlier work this paper cites.

The DStar method for effective software fault localization

W Eric Wong, Vidroha Debroy, Ruizhi Gao, and Yihao Li. 2013 · 2013

Earlier work this paper cites.

Fault localization prioritization: Comparing information-theoretic and coverage-based approaches

Shin Yoo, Mark Harman, and David Clark. 2013 · 2013

Earlier work this paper cites.

Toward large-scale vulnerability discovery using machine learning. In Proceedings of the sixth ACM conference on data and application security and privacy . 85–96

Gustavo Grieco, Guillermo Luis Grinblat, Lucas Uzal, Sanjay Rawat, Josselin Feist, and Laurent Mounier. 2016 · 2016

Earlier work this paper cites.

Practitioners’ expectations on automated fault localization. In Proceedings of the 25th International Symposium on Software Testing and Analysis

Pavneet Singh Kochhar, Xin Xia, David Lo, and Shanping Li. 2016 · 2016

Earlier work this paper cites.

An introduction to modern software quality assurance

Bruce R Maxim and Marouane Kessentini. 2016 · 2016

Earlier work this paper cites.

Improving spectral-based fault localization using static analysis

Neelofar Neelofar, Lee Naish, Jason Lee, and Kotagiri Ramamohanarao. 2017 · 2017

Earlier work this paper cites.

Evaluating and Improving Fault Localization. In 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE)

S. Pearson, J. Campos, R. Just, G. Fraser, R. Abreu, M. D. Ernst, D. Pang, and B. Keller. 2017 · 2017

Earlier work this paper cites.

Fluccs: Using code and change metrics to improve fault localization. In Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis . 273–283

Jeongju Sohn and Shin Yoo. 2017 · 2017

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

FPA-FL: Incorporating static fault-proneness analysis into statistical fault localization

Farid Feyzi and Saeed Parsa. 2018 · 2018

Earlier work this paper cites.

Androshield: Automated android applications vulnerability detection, a hybrid static and dynamic analysis approach

Amr Amin, Amgad Eldessouki, Menna Tullah Magdy, Nouran Abdeen, Hanan Hindy, and Islam Hegazy. 2019 · 2019

Earlier work this paper cites.

Sequencer: Sequence-to-sequence learning for end-to-end program repair

Zimin Chen, Steve James Kommrusch, Michele Tufano, Louis-Noël Pouchet, Denys Poshyvanyk, and Martin Monperrus. 2019 · 2019

Earlier work this paper cites.

Re-factoring based program repair applied to programming assignments. In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 388–398

Yang Hu, Umair Z Ahmed, Sergey Mechtaev, Ben Leong, and Abhik Roychoudhury. 2019 · 2019

Cited alongside, same era.

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT . 4171–4186

Jacob Devlin Ming-Wei Chang Kenton and Lee Kristina Toutanova. 2019 · 2019

Cited alongside, same era.

An empirical study of fault localization families and their combinations

Daming Zou, Jingjing Liang, Yingfei Xiong, Michael D Ernst, and Lu Zhang. 2019 · 2019

Cited alongside, same era.

Coconut: combining context-aware neural translation models using ensemble for program repair. In Proceedings of the 29th ACM SIGSOFT ISSTA

Thibaud Lutellier, Hung Viet Pham, Lawrence Pang, Yitong Li, Moshi Wei, and Lin Tan. 2020 · 2020

Cited alongside, same era.

Large Language Models in Fault Localisation

Original

Yonghao Wu, Zheng Li, Jie M Zhang, Mike Papadakis, Mark Harman, and Yong Liu. 2023 · 2023

Later among the works it cites.

Automated program repair in the era of large pre-trained language models. In Proceedings of the 45th International Conference on Software Engineering (ICSE 2023). Association for Computing Machinery

Chunqiu Steven Xia, Yuxiang Wei, and Lingming Zhang. 2023 · 2023

Later among the works it cites.

Keep the Conversation Going: Fixing 162 out of 337 bugs for $0.42 each using ChatGPT

Original

Chunqiu Steven Xia and Lingming Zhang. 2023 · 2023

Later among the works it cites.

Large language models are human-level prompt engineers. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023 . OpenReview.net

Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, Keiran Paster, Silviu Pitis, Harris Chan, and Jimmy Ba. 2023 · 2023

Later among the works it cites.