Reflective Unit Test Generation for Precise Type Error Detection with Large Language Models

A. Rigo and S. Pedroni, “Pypy’s approach to virtual machine construction,” in Companion to the 21st ACM SIGPLAN symposium on Object-oriented programming systems, languages, and applications , 2006, pp. 944–953

2006

Earlier work this paper cites.

M. Gorbovitski, Y. A. Liu, S. D. Stoller, T. Rothamel, and T. K. Tekle, “Alias analysis for optimization of dynamic languages,” in Proceedings of the 6th Symposium on Dynamic Languages , 2010, pp. 27–42

2010

Earlier work this paper cites.

M. Hassan, C. Urban, M. Eilers, and P. Müller, “Maxsmt-based type inference for python 3,” in International Conference on Computer Aided Verification . Springer, 2018, pp. 12–19

2018

Earlier work this paper cites.

R. Widyasari, S. Q. Sim, C. Lok, H. Qi, J. Phan, Q. Tay, C. Tan, F. Wee, J. E. Tan, Y. Yieh et al. , “Bugsinpy: a database of existing bugs in python programs to enable controlled testing and debugging studies,” in Proceedings of the 28th ACM joint meeting on european software engineering conference and symposium on the foundations of software engineering , 2020, pp. 1556–1560

2020

Earlier work this paper cites.

M. Tufano, D. Drain, A. Svyatkovskiy, S. K. Deng, and N. Sundaresan, “Unit test case generation with transformers and focal context,” arXiv preprint arXiv:2009.05617 , 2020

Original

2020

Earlier work this paper cites.

S. Lukasczyk and G. Fraser, “Pynguin: Automated unit test generation for python,” in Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings , 2022, pp. 168–172

2022

Earlier work this paper cites.

W. Oh and H. Oh, “Pyter: effective program repair for python type errors,” in Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering , 2022, pp. 922–934

2022

Earlier work this paper cites.

J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V. Le, D. Zhou et al. , “Chain-of-thought prompting elicits reasoning in large language models,” Advances in neural information processing systems , vol. 35, pp. 24 824–24 837, 2022

2022

Earlier work this paper cites.

E. Dinella, G. Ryan, T. Mytkowicz, and S. K. Lahiri, “Toga: A neural method for test oracle generation,” in Proceedings of the 44th International Conference on Software Engineering , 2022, pp. 2130–2141

2022

Earlier work this paper cites.

X. Chen, M. Lin, N. Schärli, and D. Zhou, “Teaching large language models to self-debug,” arXiv preprint arXiv:2304.05128 , 2023

Original

2023

Earlier work this paper cites.

C. Lemieux, J. P. Inala, S. K. Lahiri, and S. Sen, “Codamosa: Escaping coverage plateaus in test generation with pre-trained large language models,” in 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) . IEEE, 2023, pp. 919–931

2023

Earlier work this paper cites.

K. Huang, Y. Yan, B. Chen, Z. Tao, and X. Peng, “Scalable and precise application-centered call graph construction for python,” arXiv preprint arXiv:2305.05949 , 2023

Original

2023

Earlier work this paper cites.

W. Kwon, Z. Li, S. Zhuang, Y. Sheng, L. Zheng, C. H. Yu, J. E. Gonzalez, H. Zhang, and I. Stoica, “Efficient memory management for large language model serving with pagedattention,” in Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles , 2023

2023

Earlier work this paper cites.

Y. Peng, C. Wang, W. Wang, C. Gao, and M. R. Lyu, “Generative type inference for python,” in 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 2023, pp. 988–999

2023

Earlier work this paper cites.

W. Oh and H. Oh, “Towards effective static type-error detection for python,” in Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering , 2024, pp. 1808–1820

2024

Earlier work this paper cites.

X. Yin, C. Ni, X. Xu, and X. Yang, “What you see is what you get: Attention-based self-guided automatic unit test generation,” arXiv preprint arXiv:2412.00828 , 2024

Original

2024

Cited alongside, same era.

Z. Yuan, M. Liu, S. Ding, K. Wang, Y. Chen, X. Peng, and Y. Lou, “Evaluating and improving chatgpt for unit test generation,” Proceedings of the ACM on Software Engineering , vol. 1, no. FSE, pp. 1703–1726, 2024

2024

Cited alongside, same era.

G. Ryan, S. Jain, M. Shang, S. Wang, X. Ma, M. K. Ramanathan, and B. Ray, “Code-aware prompting: A study of coverage-guided test generation in regression setting using llm,” Proceedings of the ACM on Software Engineering , vol. 1, no. FSE, pp. 951–971, 2024

2024

Cited alongside, same era.

Z. Wang, K. Liu, G. Li, and Z. Jin, “Hits: High-coverage llm-based unit test generation via method slicing,” in Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering , 2024, pp. 1258–1268

2024

“deepseek,” 2025, https://www.deepseek.com

2025

Closest in time.

“rted homepage,” 2025, https://anonymous.4open.science/r/RTED-DCC5

2025

Closest in time.

“kivy,” 2025, https://github.com/kivy/kivy

2025

Closest in time.

“langchain,” 2025, https://github.com/langchain-ai/langchain

2025

Closest in time.

“luigi,” 2025, https://github.com/spotify/luigi

2025

Closest in time.

“pwntools,” 2025, https://github.com/Gallopsled/pwntools

2025

Closest in time.

“scipy,” 2025, https://github.com/scipy/scipy

2025

Closest in time.