Acceptance Test Generation with Large Language Models: An Industrial Case Study

M. Bolton, “User acceptance testing – a context-driven perspective,” in Twenty-fifth Annual Pacific Northwest Software Quality Conference . The Conference, 2007, pp. 535–548

2007

Earlier work this paper cites.

B. Haugset and G. K. Hanssen, “Automated acceptance testing: A literature review and an industrial case stud,” in Agile 2008 Conference . IEEE, 2008, pp. 27–38

2008

Earlier work this paper cites.

M. Gärtner, ATDD by example: a practical guide to acceptance test-driven development . Addison-Wesley Professional, 2013

2013

Earlier work this paper cites.

S. Kamalakar, S. H. Edwards, and T. M. Dao, “Automatically generating tests from natural language descriptions of software behavior,” in International Conference on Evaluation of Novel Software Approaches to Software Engineering , vol. 2. SCITEPRESS, 2013, pp. 238–245

2013

Earlier work this paper cites.

M. Wynne and A. Hellesøy, The Cucumber Book: Behaviour-Driven Development for Testers and Developers . The Pragmatic Bookshelf, 2017

2017

Earlier work this paper cites.

M. Moe, “Comparative study of test-driven development tdd, behavior-driven development bdd and acceptance test–driven development atdd,” International Journal of Trend in Scientific Research and Development , pp. 231–234, 06 2019

2019

Earlier work this paper cites.

T. Storer and R. Bob, “Behave nicely! automatic generation of code for behaviour driven development test suites,” in 2019 19th International Working Conference on Source Code Analysis and Manipulation (SCAM) . IEEE, 2019, pp. 228–237

2019

Earlier work this paper cites.

T. B. Brown, “Language models are few-shot learners,” arXiv preprint arXiv:2005.14165 , 2020

Original

2020

Cited alongside, same era.

M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. d. O. Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman et al. , “Evaluating large language models trained on code,” arXiv preprint arXiv:2107.03374 , 2021

Original

2021

Cited alongside, same era.

J. Austin, A. Odena, M. Nye, M. Bosma, H. Michalewski, D. Dohan, E. Jiang, C. Cai, M. Terry, Q. Le et al. , “Program synthesis with large language models,” arXiv preprint arXiv:2108.07732 , 2021

Original

2021

Cited alongside, same era.

A. Mastropaolo, L. Pascarella, E. Guglielmi, M. Ciniselli, S. Scalabrino, R. Oliveto, and G. Bavota, “On the Robustness of Code Generation Techniques: An Empirical Study on GitHub Copilot,” 2023, available at https://arxiv.org/abs/2302.00438

Original

2023

Cited alongside, same era.

BlueOptima Limited, “The impact of generative ai on software developer performance,” BlueOptima Limited, Tech. Rep., 2024, © BlueOptima Limited 2005–2024. All Rights Reserved. [Online]. Available: https://www.blueoptima.com/resource/dora-lead-time-to-change-useful-but-inadequate/

2024

Later among the works it cites.

J. Wang, Y. Huang, C. Chen, Z. Liu, S. Wang, and Q. Wang, “Software testing with large language models: Survey, landscape, and vision,” IEEE Transactions on Software Engineering , 2024

2024

Later among the works it cites.

B. García, J. M. del Alamo, M. Leotta, and F. Ricca, “Exploring browser automation: A comparative study of selenium, cypress, puppeteer, and playwright,” in International Conference on the Quality of Information and Communications Technology . Springer, 2024, pp. 142–149

2024

Later among the works it cites.

S. Karpurapu, S. Myneni, U. Nettur, L. S. Gajja, D. Burke, T. Stiehm, and J. Payne, “Comprehensive evaluation and insights into the use of large language models in the automation of behavior-driven development acceptance test formulation,” IEEE Access , vol. 12, pp. 58 715–58 721, 2024