STALL+: Boosting LLM-based Repository-level Code Completion with Static Analysis

P. Jaccard, “The distribution of the flora in the alpine zone. 1,” New phytologist , vol. 11, no. 2, pp. 37–50, 1912

1912

Earlier work this paper cites.

V. I. Levenshtein et al. , “Binary codes capable of correcting deletions, insertions, and reversals,” in Soviet physics doklady , vol. 10, no. 8. Soviet Union, 1966, pp. 707–710

1966

Earlier work this paper cites.

T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, and D. Amodei, “Language models are few-shot learners,” ArXiv , vol. abs/2005.14165, 2020. [Online]. Available: https://api.semanticscholar.org/CorpusID:218971783

Original

2020

Earlier work this paper cites.

Z. Feng, D. Guo, D. Tang, N. Duan, X. Feng, M. Gong, L. Shou, B. Qin, T. Liu, D. Jiang, and M. Zhou, “Codebert: A pre-trained model for programming and natural languages,” in Findings of the Association for Computational Linguistics: EMNLP 2020, Online Event, 16-20 November 2020 , ser. Findings of ACL, T. Cohn, Y. He, and Y. Liu, Eds., vol. EMNLP 2020. Association for Computational Linguistics, 2020, pp. 1536–1547. [Online]. Available: https://doi.org/10.18653/v1/2020.findings-emnlp.139

2020

Earlier work this paper cites.

M. Ciniselli, N. Cooper, L. Pascarella, A. Mastropaolo, E. Aghajani, D. Poshyvanyk, M. D. Penta, and G. Bavota, “An empirical study on the usage of transformer models for code completion,” IEEE Transactions on Software Engineering , vol. 48, pp. 4818–4837, 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:236881348

2021

Earlier work this paper cites.

M. Chen, J. Tworek, H. Jun, Q. Yuan, H. Ponde, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman, A. Ray, R. Puri, G. Krueger, M. Petrov, H. Khlaaf, G. Sastry, P. Mishkin, B. Chan, S. Gray, N. Ryder, M. Pavlov, A. Power, L. Kaiser, M. Bavarian, C. Winter, P. Tillet, F. P. Such, D. W. Cummings, M. Plappert, F. Chantzis, E. Barnes, A. Herbert-Voss, W. H. Guss, A. Nichol, I. Babuschkin, S. Balaji, S. Jain, A. Carr, J. Leike, J. Achiam, V. Misra, E. Morikawa, A. Radford, M. M. Knight, M. Brundage, M. Murati, K. Mayer, P. Welinder, B. McGrew, D. Amodei, S. McCandlish, I. Sutskever, and W. Zaremba, “Evaluating large language models trained on code,” ArXiv , vol. abs/2107.03374, 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:235755472

Original

2021

Earlier work this paper cites.

S. Lu, D. Guo, S. Ren, J. Huang, A. Svyatkovskiy, A. Blanco, C. B. Clement, D. Drain, D. Jiang, D. Tang, G. Li, L. Zhou, L. Shou, L. Zhou, M. Tufano, M. Gong, M. Zhou, N. Duan, N. Sundaresan, S. K. Deng, S. Fu, and S. Liu, “Codexglue: A machine learning benchmark dataset for code understanding and generation,” ArXiv , vol. abs/2102.04664, 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:231855531

Original

2021

Earlier work this paper cites.

J. Austin, A. Odena, M. Nye, M. Bosma, H. Michalewski, D. Dohan, E. Jiang, C. J. Cai, M. Terry, Q. V. Le, and C. Sutton, “Program synthesis with large language models,” ArXiv , vol. abs/2108.07732, 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:237142385

Original

2021

Earlier work this paper cites.

Codex , 2021, https://openai.com/blog/openai-codex

2021

Earlier work this paper cites.

J. Li, R. Huang, W. Li, K. Yao, and W. Tan, “Toward less hidden cost of code completion with acceptance and ranking models,” in 2021 IEEE International Conference on Software Maintenance and Evolution (ICSME) . IEEE, 2021, pp. 195–205

2021

Earlier work this paper cites.

Y. Ding, Z. Wang, W. U. Ahmad, M. K. Ramanathan, R. Nallapati, P. Bhatia, D. Roth, and B. Xiang, “Cocomic: Code completion by jointly modeling in-file and cross-file context,” CoRR , vol. abs/2212.10007, 2022. [Online]. Available: https://doi.org/10.48550/arXiv.2212.10007

Original

2022

Earlier work this paper cites.

J. Wei, X. Wang, D. Schuurmans, M. Bosma, E. H. hsin Chi, F. Xia, Q. Le, and D. Zhou, “Chain of thought prompting elicits reasoning in large language models,” ArXiv , vol. abs/2201.11903, 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:246411621

Original

2022

Earlier work this paper cites.

D. Zhou, N. Scharli, L. Hou, J. Wei, N. Scales, X. Wang, D. Schuurmans, O. Bousquet, Q. Le, and E. H. hsin Chi, “Least-to-most prompting enables complex reasoning in large language models,” ArXiv , vol. abs/2205.10625, 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:248986239

Original

2022

Earlier work this paper cites.

S. Lu, N. Duan, H. Han, D. Guo, S. won Hwang, and A. Svyatkovskiy, “Reacc: A retrieval-augmented code completion framework,” ArXiv , vol. abs/2203.07722, 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:247450969

Original

2022

Earlier work this paper cites.

W. Takerngsaksiri, C. K. Tantithamthavorn, and Y. Li, “Syntax-aware on-the-fly code completion,” Inf. Softw. Technol. , vol. 165, p. 107336, 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:253420520

2022

Earlier work this paper cites.

D. Zan, B. Chen, F. Zhang, D. Lu, B. Wu, B. Guan, Y. Wang, and J.-G. Lou, “Large language models meet nl2code: A survey,” in Annual Meeting of the Association for Computational Linguistics , 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:258557362

2022

Earlier work this paper cites.

OpenAI: Introducing ChatGPT , 2022, https://openai.com/blog/chatgpt/

2022

Earlier work this paper cites.

L. A. Agrawal, A. Kanade, N. Goyal, S. K. Lahiri, and S. K. Rajamani, “Guiding language models of code with global context using monitors,” CoRR , vol. abs/2306.10763, 2023. [Online]. Available: https://doi.org/10.48550/arXiv.2306.10763

Original

2023

Earlier work this paper cites.

F. Zhang, B. Chen, Y. Zhang, J. Keung, J. Liu, D. Zan, Y. Mao, J. Lou, and W. Chen, “Repocoder: Repository-level code completion through iterative retrieval and generation,” in Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023 , H. Bouamor, J. Pino, and K. Bali, Eds. Association for Computational Linguistics, 2023, pp. 2471–2484. [Online]. Available: https://aclanthology.org/2023.emnlp-main.151

2023

Earlier work this paper cites.

D. Shrivastava, D. Kocetkov, H. de Vries, D. Bahdanau, and T. Scholak, “Repofusion: Training code models to understand your repository,” CoRR , vol. abs/2306.10998, 2023. [Online]. Available: https://doi.org/10.48550/arXiv.2306.10998

Original

2023

Earlier work this paper cites.

Y. Ding, Z. Wang, W. U. Ahmad, H. Ding, M. Tan, N. Jain, M. K. Ramanathan, R. Nallapati, P. Bhatia, D. Roth, and B. Xiang, “Crosscodeeval: A diverse and multilingual benchmark for cross-file code completion,” in Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023 , A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, Eds., 2023. [Online]. Available: http://papers.nips.cc/paper_files/paper/2023/hash/920f2dced7d32ab2ba2f1970bc306af6-Abstract-Datasets_and_Benchmarks.html

2023

Earlier work this paper cites.

D. Shrivastava, H. Larochelle, and D. Tarlow, “Repository-level prompt generation for large language models of code,” in Proceedings of the 40th International Conference on Machine Learning , ser. Proceedings of Machine Learning Research, A. Krause, E. Brunskill, K. Cho, B. Engelhardt, S. Sabato, and J. Scarlett, Eds., vol. 202. PMLR, 23–29 Jul 2023, pp. 31 693–31 715. [Online]. Available: https://proceedings.mlr.press/v202/shrivastava23a.html

2023

Earlier work this paper cites.

T. Liu, C. Xu, and J. McAuley, “Repobench: Benchmarking repository-level code auto-completion systems,” ArXiv , vol. abs/2306.03091, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:259075246

Original

2023

Earlier work this paper cites.

R. Bairi, A. Sonwane, A. Kanade, C. VageeshD, A. S. Iyer, S. Parthasarathy, S. K. Rajamani, B. Ashok, and S. P. Shet, “Codeplan: Repository-level coding using llms and planning,” ArXiv , vol. abs/2309.12499, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:262217135

Original

2023

Earlier work this paper cites.

J. Li, G. Li, Y. Li, and Z. Jin, “Structured chain-of-thought prompting for code generation,” 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:258615421

2023

Earlier work this paper cites.

T. van Dam, M. Izadi, and A. van Deursen, “Enriching source code with contextual data for code completion models: An empirical study,” 2023 IEEE/ACM 20th International Conference on Mining Software Repositories (MSR) , pp. 170–182, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:258298223

2023

Cited alongside, same era.

C. Lemieux, J. P. Inala, S. K. Lahiri, and S. Sen, “Codamosa: Escaping coverage plateaus in test generation with pre-trained large language models,” in 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) . IEEE, 2023, pp. 919–931

2023

Cited alongside, same era.

Z. Tang, J. Ge, S. Liu, T. Zhu, T. Xu, L. Huang, and B. Luo, “Domain adaptive code completion via language models and decoupled domain databases,” 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) , pp. 421–433, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:261030382

2023

Cited alongside, same era.

M. Schäfer, S. Nadi, A. Eghbali, and F. Tip, “Adaptive test generation using a large language model,” CoRR , vol. abs/2302.06527, 2023. [Online]. Available: https://doi.org/10.48550/arXiv.2302.06527

A. Ni, S. Iyer, D. Radev, V. Stoyanov, W.-t. Yih, S. Wang, and X. V. Lin, “Lever: Learning to verify language-to-code generation with execution,” in International Conference on Machine Learning . PMLR, 2023, pp. 26 106–26 128

2023

Later among the works it cites.

D. Guo, C. Xu, N. Duan, J. Yin, and J. Mcauley, “LongCoder: A long-range pre-trained language model for code completion,” in Proceedings of the 40th International Conference on Machine Learning , ser. Proceedings of Machine Learning Research, A. Krause, E. Brunskill, K. Cho, B. Engelhardt, S. Sabato, and J. Scarlett, Eds., vol. 202. PMLR, 23–29 Jul 2023, pp. 12 098–12 107. [Online]. Available: https://proceedings.mlr.press/v202/guo23j.html

2023

Later among the works it cites.

Y. Wei, C. S. Xia, and L. Zhang, “Copiloting the copilots: Fusing large language models with completion engines for automated program repair,” in Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2023, San Francisco, CA, USA, December 3-9, 2023 , S. Chandra, K. Blincoe, and P. Tonella, Eds. ACM, 2023, pp. 172–184. [Online]. Available: https://doi.org/10.1145/3611643.3616271