Exploring the Problems, their Causes and Solutions of AI Pair Programming: A Study on GitHub and Stack Overflow

A coefficient of agreement for nominal scales

Cohen, J., 1960 · 1960

Earlier work this paper cites.

Guidelines for conducting and reporting case study research in software engineering

Runeson, P., Höst, M., 2009 · 2009

Earlier work this paper cites.

Recommendation systems for software engineering

Robillard, M., Walker, R., Zimmermann, T., 2010 · 2010

Earlier work this paper cites.

Coding in-depth semistructured interviews: Problems of unitization and intercoder reliability and agreement

Campbell, J.L., Quincy, C., Osserman, J., Pedersen, O.K., 2013 · 2013

Earlier work this paper cites.

Grounded theory in software engineering research: a critical review and guidelines, in: Proceedings of the 38th International conference on software engineering (ICSE), ACM. pp. 120–131

Stol, K.J., Ralph, P., Fitzgerald, B., 2016 · 2016

Earlier work this paper cites.

Eclipse Code Recommenders

Eclipse, 2019 · 2019

Earlier work this paper cites.

Aroma: Code recommendation via structural code search

Luan, S., Yang, D., Barnaby, C., Sen, K., Chandra, S., 2019 · 2019

Earlier work this paper cites.

Program synthesis with large language models

Original

Austin, J., Odena, A., Nye, M., Bosma, M., Michalewski, H., Dohan, D., Jiang, E., Cai, C., Terry, M., Le, Q., et al., 2021 · 2021

Earlier work this paper cites.

Evaluating large language models trained on code

Chen, M., Tworek, J., Jun, H., Yuan, Q., de Oliveira Pinto, H.P., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., Ray, A., Puri, R., Krueger, G., Petrov, M., Khlaaf, H., Sastry, G., Mishkin, P., Chan, B., Gray, S., Ryder, N., Pavlov, M., Power, A., Kaiser, L., Bavarian, M., Winter, C., Tillet, P., Such, F.P., Cummings, D., Plappert, M., Chantzis, F., Barnes, E., Herbert-Voss, A., Guss, W.H., Nichol, A., Paino, A., Tezak, N., Tang, J., Babuschkin, I., Balaji, S., Jain, S., Saunders, W., Hesse, C., Carr, A.N., Leike, J., Achiam, J., Misra, V., Morikawa, E., Radford, A., Knight, M., Brundage, M., Murati, M., Mayer, K., Welinder, P., McGrew, B., Amodei, D., McCandlish, S., Sutskever, I., Zaremba, W., 2021 · 2021

Earlier work this paper cites.

Understanding quantum software engineering challenges an empirical study on stack exchange forums and github issues, in: Proceedings of 37th IEEE International Conference on Software Maintenance and Evolution (ICSME)

El aoun, M.R., Li, H., Khomh, F., Openja, M., 2021 · 2021

Earlier work this paper cites.

Perfection not required? human-ai partnerships in code translation, in: Proceedings of the 26th International Conference on Intelligent User Interfaces (IUI), ACM. p. 402–412

Weisz, J.D., Muller, M., Houde, S., Richards, J., Ross, S.I., Martinez, F., Agarwal, M., Talamadupula, K., 2021 · 2021

Earlier work this paper cites.

Is github copilot a substitute for human pair-programming? an empirical study, in: Proceedings of the 44th International Conference on Software Engineering (ICSE): Companion, IEEE. pp. 319–321

Imai, S., 2022 · 2022

Earlier work this paper cites.

An empirical evaluation of github copilot’s code suggestions, in: Proceedings of the 19th IEEE/ACM International Conference on Mining Software Repositories (MSR), IEEE. pp. 1–5

Nguyen, N., Nadi, S., 2022 · 2022

Earlier work this paper cites.

Asleep at the keyboard? assessing the security of github copilot’s code contributions, in: Proceedings of the 43rd IEEE Symposium on Security and Privacy (S&P), IEEE. pp. 754–768

Pearce, H., Ahmad, B., Tan, B., Dolan-Gavitt, B., Karri, R., 2022 · 2022

Earlier work this paper cites.

An empirical study of code smells in transformer-based code generation techniques, in: Proceedings of the 22nd International Working Conference on Source Code Analysis and Manipulation (SCAM), IEEE. pp. 71–82

Siddiq, M.L., Majumder, S.H., Mim, M.R., Jajodia, S., Santos, J.C., 2022 · 2022

Earlier work this paper cites.

Choose your programming copilot: A comparison of the program synthesis performance of github copilot and genetic programming, in: Proceedings of the 24th Genetic and Evolutionary Computation Conference (GECCO), ACM. pp. 1019–1027

Sobania, D., Briesch, M., Rothlauf, F., 2022 · 2022

Earlier work this paper cites.

Expectation vs. experience: Evaluating the usability of code generation tools powered by large language models, in: Proceedings of the 42nd CHI Conference on Human Factors in Computing Systems (CHI) Extended Abstracts, ACM. pp. 1–7

Vaithilingam, P., Zhang, T., Glassman, E.L., 2022 · 2022

Cited alongside, same era.

Emergent abilities of large language models

Original

Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., Chi, E.H., Hashimoto, T., Vinyals, O., Liang, P., Dean, J., Fedus, W., 2022 · 2022

Cited alongside, same era.

Assessing the quality of github copilot’s code generation, in: Proceedings of the 18th International Conference on Predictive Models and Data Analytics in Software Engineering (PROMISE), ACM. pp. 62–71

Yetistiren, B., Ozsoy, I., Tuzun, E., 2022 · 2022

Cited alongside, same era.

Ethical aspects of chatgpt in software engineering research

Akbar, M.A., Khan, A.A., Liang, P., 2023 · 2023

Cited alongside, same era.

Github copilot ai pair programmer: Asset or liability?

Moradi Dakhel, A., Majdinasab, V., Nikanjam, A., Khomh, F., Desmarais, M.C., Jiang, Z.M., 2023 · 2023

Closest in time.

The impact of ai on developer productivity: Evidence from github copilot

Original

Peng, S., Kalliamvakou, E., Cihon, P., Demirer, M., 2023 · 2023

Closest in time.

Demystifying practices, challenges and expected features of using github copilot

Zhang, B., Liang, P., Zhou, X., Ahmad, A., Waseem, M., 2023 · 2023

Closest in time.

GitHub Copilot Chat

Zhao, S., 2023 · 2023

Closest in time.

Amazon Q Developer: The most capable generative AI–powered assistant for software development

AWS, 2024 · 2024

Closest in time.

Security weaknesses of copilot generated code in github