Large Language Models for Automated Web-Form-Test Generation: An Empirical Study

Flakify: A black-box, language model-based predictor for flaky tests

Sakina Fatima, Taher A Ghaleb, and Lionel Briand. 2023 · 1927

Earlier work this paper cites.

Individual comparisons by ranking methods

Frank Wilcoxon. 1945 · 1945

Earlier work this paper cites.

Nonparametric statistics

Sidney Siegel. 1957 · 1957

Earlier work this paper cites.

On the origins of the .05 level of statistical significance

Michael Cowles and Caroline Davis. 1982 · 1982

Earlier work this paper cites.

An empirical study of the reliability of UNIX utilities

Barton P Miller, Lars Fredriksen, and Bryan So. 1990 · 1990

Earlier work this paper cites.

Structured entry of radiology reports using world wide web technology

Charles E Kahn Jr, Kun Wang, and Douglas S Bell. 1996 · 1996

Earlier work this paper cites.

What you see is what you test: A methodology for testing form-based visual programs. In Proceedings of the 20th International Conference on Software Engineering (ICSE’98) . 198–207

Gregg Rothermel, Lixin Li, Christopher DuPuis, and Margaret Burnett. 1998 · 1998

Earlier work this paper cites.

Qualitative methods in empirical studies of software engineering

Carolyn B. Seaman. 1999 · 1999

Earlier work this paper cites.

A critique and improvement of the CL common language effect size statistics of McGraw and Wong

András Vargha and Harold D Delaney. 2000 · 2000

Earlier work this paper cites.

Analysis and testing of web applications. In Proceedings of the 23rd International Conference on Software Engineering (ICSE’01) . 25–34

Filippo Ricca and Paolo Tonella. 2001 · 2001

Earlier work this paper cites.

Dynamic HTML: The definitive reference

Danny Goodman. 2002 · 2002

Earlier work this paper cites.

Document object model

Joe Marini. 2002 · 2002

Earlier work this paper cites.

Evolutionary testing of classes. In Proceedings of the 13th International Symposium on Software Testing and Analysis (ISSTA’04) . 119–128

Paolo Tonella. 2004 · 2004

Earlier work this paper cites.

Search-based software test data generation for string data using program-specific search operators

Mohammad Alshraideh and Leonardo Bottaci. 2006a · 2006

Earlier work this paper cites.

Search-based software test data generation for string data using program-specific search operators

Mohammad Aref Alshraideh and Leonardo Bottaci. 2006b · 2006

Earlier work this paper cites.

Enumeration and generation with a string automata representation

Marco Almeida, Nelma Moreira, and Rogério Reis. 2007 · 2007

Earlier work this paper cites.

Model checking-based verification of web application. In Proceedings of the 12th IEEE International Conference on Engineering Complex Computer Systems (ICECCS’07) . 47–55

Huaikou Miao and Hongwei Zeng. 2007 · 2007

Earlier work this paper cites.

Forms that work: Designing web forms for usability

Caroline Jarrett and Gerry Gaffney. 2009 · 2009

Earlier work this paper cites.

Automatic string test data generation for detecting domain errors

Ruilian Zhao, Michael R Lyu, and Yinghua Min. 2010 · 2010

Earlier work this paper cites.

Working towards usable forms on the world wide web: Optimizing multiple selection interface elements

Javier A Bargas-Avila, Olivia Brenzikofer, Alexandre N Tuch, Sandra P Roth, and Klaus Opwis. 2011 · 2011

Earlier work this paper cites.

James Garrett Jesse. 2011

2011

Earlier work this paper cites.

Search-based test input generation for string data types using the results of web queries. In Proceedings of the IEEE 5th International Conference on Software Testing, Verification and Validation (ICST’12) . 141–150

Phil McMinn, Muzammil Shahbaz, and Mark Stevenson. 2012 · 2012

Earlier work this paper cites.

Invariant-based automatic testing of modern web applications

Ali Mesbah, Arie van Deursen, and Danny Roest. 2012 · 2012

Earlier work this paper cites.

The ontological key: Automatically understanding and integrating forms to access the deep web

Tim Furche, Georg Gottlob, Giovanni Grasso, Xiaonan Guo, Giorgio Orsi, and Christian Schallhart. 2013 · 2013

Earlier work this paper cites.

A probabilistic approach to string transformation

Ziqi Wang, Gu Xu, Hang Li, and Ming Zhang. 2013 · 2013

Earlier work this paper cites.

A Hitchhiker’s guide to statistical tests for assessing randomized algorithms in software engineering

Andrea Arcuri and Lionel C. Briand. 2014 · 2014

Earlier work this paper cites.

Two decades of web application testing—A survey of recent advances

Yuan-Fang Li, Paramjit K. Das, and David L. Dowe. 2014 · 2014

Earlier work this paper cites.

Designing usable web forms: Empirical evaluation of web form improvement guidelines. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’14) . 1275–1284

Mirjam Seckler, Silvia Heinz, Javier A Bargas-Avila, Klaus Opwis, and Alexandre N Tuch. 2014 · 2014

Earlier work this paper cites.

Automatic generation of valid and invalid test data for string validation routines using web searches and regular expressions

Muzammil Shahbaz, Phil McMinn, and Mark Stevenson. 2015 · 2015

Earlier work this paper cites.

Securing web applications from injection and logic vulnerabilities: Approaches and challenges

G Deepa and P Santhi Thilagam. 2016 · 2016

Earlier work this paper cites.

Approaches and tools for automated end-to-end web testing

Maurizio Leotta, Diego Clerissi, Filippo Ricca, and Paolo Tonella. 2016 · 2016

Earlier work this paper cites.

Using fNIRS in usability testing: Understanding the effect of web form layout on mental workload. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI’16) . 4011–4016

Kristiyan Lukanov, Horia A Maior, and Max L Wilson. 2016 · 2016

Earlier work this paper cites.

Enabling adaptability in web forms based on user characteristics detection through A/B testing and machine learning

Juan Cruz-Benito, Andrea Vázquez-Ingelmo, José Carlos Sánchez-Prieto, Roberto Theron, Francisco José García-Peñalvo, and Martin Martin-Gonzalez. 2017 · 2017

Earlier work this paper cites.

Attention is all you need. In Proceedings of the 30th Annual Conference on Neural Information Processing Systems (NeurIPS’17) . 5998–6008

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Automation testing framework for web applications with Selenium WebDriver: Opportunities and threats. In Proceedings of the International Conference on Advances in Image Processing (ICAIP’17) . 144–150

Elior Vila, Galia Novakova, and Diana Todorova. 2017 · 2017

Earlier work this paper cites.

Selenium WebDriver 3 practical guide: End-to-end automation testing for web and mobile browsers with Selenium WebDriver (2rd ed.)

Unmesh Gundecha and Satya Avasarala. 2018 · 2018

Earlier work this paper cites.

A survey of detection methods for XSS attacks

Upasana Sarmah, DK Bhattacharyya, and Jugal K Kalita. 2018 · 2018

Cited alongside, same era.

Cross-browser differences detection based on an empirical metric for web page visual similarity

Zhen Xu and James Miller. 2018 · 2018

Cited alongside, same era.

Leveraging keyword-guided exploration to build test models for web applications

Xiao-Fang Qi, Yun-Long Hua, Peng Wang, and Zi-Yuan Wang. 2019 · 2019

Cited alongside, same era.

Language models are unsupervised multitask learners

Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019

Cited alongside, same era.

Machine learning and constraint solving for automated form testing. In Proceedings of the IEEE 30th International Symposium on Software Reliability Engineering (ISSRE’19) . 217–227

Dionny Santiago, Justin Phillips, Patrick Alt, Brian Muras, Tariq M. King, and Peter J. Clarke. 2019 · 2019

Cited alongside, same era.

Impact of large language models on generating software specifications

Danning Xie, Byungwoo Yoo, Nan Jiang, Mijung Kim, Lin Tan, Xiangyu Zhang, and Judy S Lee. 2023 · 2023

Later among the works it cites.

Baichuan 2: Open large-scale language models

Aiyuan Yang, Bin Xiao, Bingning Wang, Borong Zhang, Ce Bian, Chao Yin, Chenxu Lv, Da Pan, Dian Wang, Dong Yan, Fan Yang, Fei Deng, Feng Wang, Feng Liu, Guangwei Ai, Guosheng Dong, Haizhou Zhao, Hang Xu, Haoze Sun, Hongda Zhang, Hui Liu, Jiaming Ji, Jian Xie, Juntao Dai, Kun Fang, Lei Su, Liang Song, Lifeng Liu, Liyun Ru, Luyao Ma, Mang Wang, Mickel Liu, MingAn Lin, Nuolan Nie, Peidong Guo, Ruiyang Sun, Tao Zhang, Tianpeng Li, Tianyu Li, Wei Cheng, Weipeng Chen, Xiangrong Zeng, Xiaochuan Wang, Xiaoxi Chen, Xin Men, Xin Yu, Xuehai Pan, Yanjun Shen, Yiding Wang, Yiyu Li, Youxin Jiang, Yuchen Gao, Yupeng Zhang, Zenan Zhou, and Zhiying Wu. 2023 · 2023

Later among the works it cites.

LLM for test script generation and migration: Challenges, capabilities, and opportunities. In Proceedings of the IEEE 23rd International Conference on Software Quality, Reliability, and Security (QRS’23) . 206–217

Shengcheng Yu, Chunrong Fang, Yuchen Ling, Chentian Wu, and Zhenyu Chen. 2023 · 2023

Later among the works it cites.

GLM-130B: An open bilingual pre-trained model. In Proceedings of the Eleventh International Conference on Learning Representations (ICLR’23)

Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, Hanyu Lai, Ming Ding, Zhuoyi Yang, Yifan Xu, Wendi Zheng, Xiao Xia, Weng Lam Tam, Zixuan Ma, Yufei Xue, Jidong Zhai, Wenguang Chen, Zhiyuan Liu, Peng Zhang, Yuxiao Dong, and Jie Tang. 2023 · 2023