ASTER: Natural and Multi-language Unit Test Generation with LLMs

W. Visser, C. S. Pasareanu, and S. Khurshid, “Test input generation with java pathfinder,” in Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis , 2004, p. 97–107

2004

Earlier work this paper cites.

P. Tonella, “Evolutionary testing of classes,” in Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis , 2004, p. 119–128

2004

Earlier work this paper cites.

P. McMinn, “Search-based software test data generation: A survey: Research articles,” Softw. Test. Verif. Reliab. , vol. 14, no. 2, pp. 105–156, Jun. 2004

2004

Earlier work this paper cites.

P. Godefroid, N. Klarlund, and K. Sen, “Dart: Directed automated random testing,” in Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation , 2005, pp. 213–223

2005

Earlier work this paper cites.

K. Sen, D. Marinov, and G. Agha, “Cute: A concolic unit testing engine for c,” ACM SIGSOFT Software Engineering Notes , vol. 30, no. 5, pp. 263–272, 2005

2005

Earlier work this paper cites.

T. Xie, D. Marinov, W. Schulte, and D. Notkin, “Symstra: A framework for generating object-oriented unit tests using symbolic execution,” in Proceedings of the 11th International Conference on Tools and Algorithms for the Construction and Analysis of Systems , 2005, p. 365–381

2005

Earlier work this paper cites.

C. Pacheco, S. K. Lahiri, M. D. Ernst, and T. Ball, “Feedback-directed random test generation,” in 29th International Conference on Software Engineering (ICSE’07) . IEEE, 2007, pp. 75–84

2007

Earlier work this paper cites.

C. Pacheco and M. D. Ernst, “Randoop: feedback-directed random testing for java,” in Companion to the 22nd ACM SIGPLAN conference on Object-oriented programming systems and applications companion , 2007, pp. 815–816

2007

Earlier work this paper cites.

C. Cadar, D. Dunbar, and D. Engler, “Klee: Unassisted and automatic generation of high-coverage tests for complex systems programs,” in Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation , 2008, p. 209–224

2008

Earlier work this paper cites.

N. Tillmann and J. De Halleux, “Pex–white box test generation for. net,” in International conference on tests and proofs . Springer, 2008, pp. 134–153

2008

Earlier work this paper cites.

I. Ciupa, A. Leitner, M. Oriol, and B. Meyer, “ARTOO: Adaptive random testing for object-oriented software,” in Proceedings of the 30th International Conference on Software Engineering , 2008, p. 71–80

2008

Earlier work this paper cites.

Y. Lin, X. Tang, Y. Chen, and J. Zhao, “A divergence-oriented approach to adaptive random testing of java programs,” in 2009 IEEE/ACM International Conference on Automated Software Engineering , 2009, pp. 221–232

2009

Earlier work this paper cites.

C. S. Păsăreanu and N. Rungta, “Symbolic pathfinder: Symbolic execution of java bytecode,” in Proceedings of the IEEE/ACM International Conference on Automated Software Engineering , 2010, p. 179–180

2010

Earlier work this paper cites.

M. Harman and P. McMinn, “A theoretical and empirical study of search-based testing: Local, global, and hybrid search,” IEEE Transactions on Software Engineering , vol. 36, no. 2, pp. 226–247, 2010

2010

Earlier work this paper cites.

T. Y. Chen, F.-C. Kuo, R. G. Merkel, and T. H. Tse, “Adaptive random testing: The ART of test case diversity,” J. Syst. Softw. , vol. 83, no. 1, p. 60–66, Jan. 2010

2010

Earlier work this paper cites.

G. Fraser and A. Arcuri, “EvoSuite: Automatic test suite generation for object-oriented software,” in Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering , 2011, pp. 416–419

2011

Earlier work this paper cites.

A. Arcuri and L. Briand, “Adaptive random testing: An illusion of effectiveness?” in Proceedings of the 2011 International Symposium on Software Testing and Analysis , 2011, p. 265–275

2011

Earlier work this paper cites.

G. Fraser, M. Staats, P. McMinn, A. Arcuri, and F. Padberg, “Does automated unit test generation really help software testers? a controlled empirical study,” ACM Trans. Softw. Eng. Methodol. , Sep. 2015

2015

Earlier work this paper cites.

A. Arcuri, “Restful api automated test case generation with evomaster,” ACM Transactions on Software Engineering and Methodology (TOSEM) , vol. 28, no. 1, pp. 1–37, 2019

2019

Earlier work this paper cites.

A. Panichella, S. Panichella, G. Fraser, A. A. Sawant, and V. J. Hellendoorn, “Revisiting test smells in automatically generated tests: Limitations, pitfalls, and opportunities,” in 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME) , 2020, pp. 523–533

2020

Earlier work this paper cites.

A. Peruma, K. Almalki, C. D. Newman, M. W. Mkaouer, A. Ouni, and F. Palomba, “tsdetect: an open source test smells detection tool,” in Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering , 2020, p. 1650–1654

2020

Earlier work this paper cites.

M. Tufano, D. Drain, A. Svyatkovskiy, S. K. Deng, and N. Sundaresan, “Unit test case generation with transformers and focal context,” arXiv preprint arXiv:2009.05617 , 2020

Original

2020

Earlier work this paper cites.

Y. Lin, Y. S. Ong, J. Sun, G. Fraser, and J. S. Dong, “Graph-based seed object synthesis for search-based unit testing,” in Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering , 2021, p. 1068–1080

2021

Earlier work this paper cites.

S. Lukasczyk and G. Fraser, “Pynguin: Automated unit test generation for python,” in Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings , 2022, pp. 168–172

2022

Cited alongside, same era.

R. Tzoref-Brill, S. Sinha, A. A. Nassar, V. Goldin, and H. Kermany, “Tackletest: A tool for amplifying test generation via type-based combinatorial coverage,” in 2022 IEEE Conference on Software Testing, Verification and Validation (ICST) . IEEE, 2022, pp. 444–455

2022

Cited alongside, same era.

P. Bareiß, B. Souza, M. d’Amorim, and M. Pradel, “Code generation tools (almost) for free? a study of few-shot, pre-trained language models on code,” arXiv preprint arXiv:2206.01335 , 2022

Original

2022

Cited alongside, same era.

M. Tufano, D. Drain, A. Svyatkovskiy, and N. Sundaresan, “Generating accurate assert statements for unit test cases using pretrained transformers,” in Proceedings of the 3rd ACM/IEEE International Conference on Automation of Software Test , 2022, pp. 54–64

“Apache Commons Codec,” 2024. [Online]. Available: https://github.com/apache/commons-codec

2024

Closest in time.

“Apache Commons Compress,” 2024. [Online]. Available: https://github.com/apache/commons-compress

2024

Closest in time.

“Eclipse Cargo Tracker,” 2024. [Online]. Available: https://github.com/eclipse-ee4j/cargotracker

2024

Closest in time.

“DayTrader8 Sample,” 2024. [Online]. Available: https://github.com/OpenLiberty/sample.daytrader8

2024

Closest in time.

“Spring PetClinic Sample Application,” 2024. [Online]. Available: https://github.com/spring-projects/spring-petclinic

2024

Closest in time.

“CodaMOSA Artifact,” 2024. [Online]. Available: https://github.com/microsoft/codamosa/tree/main/replication