Fetching the paper…
Reading the bibliography…
How much does AI assistance impact developer productivity? To date, the software engineering literature has provided a range of answers, targeting a diversity of outcomes: from perceived productivity to speed on task and developer throughput.
K. A. Ericsson, R. T. Krampe, and C. Tesch-Römer, “The role of deliberate practice in the acquisition of expert performance.” Psychological review , vol. 100, no. 3, p. 363, 1993
1993
Earlier work this paper cites.
P. C. Beatty and G. B. Willis, “Research synthesis: The practice of cognitive interviewing,” Public Opinion Quarterly , vol. 71, no. 2, pp. 287–311, 05 2007
2007
Earlier work this paper cites.
A. Hernández-López, R. Colomo-Palacios, and Á. García-Crespo, “Software engineering job productivity—a systematic review,” International Journal of Software Engineering and Knowledge Engineering , vol. 23, no. 03, pp. 387–406, 2013
2013
Earlier work this paper cites.
A. Deaton and N. Cartwright, “Understanding and misunderstanding randomized controlled trials,” Social Science & Medicine , vol. 210, pp. 2–21, 2018, randomized Controlled Trials and Evidence-based Policy: A Multidisciplinary Dialogue
2018
Earlier work this paper cites.
E. Murphy-Hill, C. Jaspan, C. Sadowski, D. Shepherd, M. Phillips, C. Winter, A. Knight, E. Smith, and M. Jorde, “What predicts software developers’ productivity?” IEEE Transactions on Software Engineering , vol. 47, no. 3, pp. 582–594, 2019
2019
Earlier work this paper cites.
L. Varpio, E. Paradis, S. Uijtdehaage, and M. Young, “The distinctions between theory, theoretical framework, and conceptual framework,” Academic medicine , vol. 95, no. 7, pp. 989–994, 2020
2020
Earlier work this paper cites.
A. Schepman and P. Rodway, “Initial validation of the general attitudes towards artificial intelligence scale,” Computers in Human Behavior Reports , vol. 1, p. 100014, 2020
2020
Earlier work this paper cites.
J. Bader, S. S. Kim, F. S. Luan, S. Chandra, and E. Meijer, “Ai in software engineering at facebook,” IEEE Software , vol. 38, no. 4, pp. 52–61, 2021
2021
Earlier work this paper cites.
N. Forsgren, M.-A. Storey, C. Maddila, T. Zimmermann, B. Houck, and J. Butler, “The space of developer productivity: There’s more to it than you think.” Queue , vol. 19, no. 1, p. 20–48, mar 2021
2021
Earlier work this paper cites.
S. Garg, R. Z. Moghaddam, C. B. Clement, N. Sundaresan, and C. Wu, “Deepdev-perf: a deep learning-based approach for improving software performance,” in Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering , 2022, p. 948–958
2022
Earlier work this paper cites.
A. Ziegler, E. Kalliamvakou, X. A. Li, A. Rice, D. Rifkin, S. Simister, G. Sittampalam, and E. Aftandilian, “Productivity assessment of neural code completion,” in Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming , 2022, pp. 21–29
2022
Earlier work this paper cites.
P. Vaithilingam, T. Zhang, and E. L. Glassman, “Expectation vs. experience: Evaluating the usability of code generation tools powered by large language models,” in Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems , 2022
2022
Earlier work this paper cites.
S. Imai, “Is github copilot a substitute for human pair-programming? an empirical study,” in 2022 IEEE/ACM 44th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) , 2022, pp. 319–321
2022
Earlier work this paper cites.
2023
Earlier work this paper cites.
2023
Earlier work this paper cites.
J. Prather, B. N. Reeves, P. Denny, B. A. Becker, J. Leinonen, A. Luxton-Reilly, G. Powell, J. Finnie-Ansley, and E. A. Santos, ““it’s weird that it knows what i want”: Usability and interactions with copilot for novice programmers,” ACM Trans. Comput.-Hum. Interact. , vol. 31, no. 1, Nov. 2023
2023
Earlier work this paper cites.
M. Kazemitabaar, J. Chow, C. K. T. Ma, B. J. Ericson, D. Weintrop, and T. Grossman, “Studying the effect of ai code generators on supporting novice learners in introductory programming,” in Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems , 2023, pp. 1–23
2023
Earlier work this paper cites.
M. Amoozadeh, D. Daniels, S. Chen, D. Nam, A. Kumar, M. Hilton, M. A. Alipour, and S. S. Ragavan, “Towards characterizing trust in generative artificial intelligence among students,” in Proceedings of the 2023 ACM Conference on International Computing Education Research - Volume 2 , 2023, p. 3–4
2023
Earlier work this paper cites.
C. Bird, D. Ford, T. Zimmermann, N. Forsgren, E. Kalliamvakou, T. Lowdermilk, and I. Gazit, “Taking flight with copilot,” Commun. ACM , vol. 66, no. 6, p. 56–62, May 2023
2023
Cited alongside, same era.
A. Murillo, A. Macvean, I. Chu, Q. Madison, and S. D’Angelo, ““if it’s what i wanted that’s great, but if it’s not, i just wasted time”: Unpacking the perceived costs/benefits of ml enhanced developer tooling.” in Proc. Deep Learning 4 Code Workshop , 2023, pp. 1–9
2023
Cited alongside, same era.
S. Kelly, S.-A. Kaye, and O. Oviedo-Trespalacios, “What factors contribute to the acceptance of artificial intelligence? a systematic review,” Telematics and Informatics , vol. 77, p. 101925, 2023
2023
Cited alongside, same era.
J. Bergdahl, R. Latikka, M. Celuch, I. Savolainen, E. Soares Mantere, N. Savela, and A. Oksanen, “Self-determination and attitudes toward artificial intelligence: Cross-national and longitudinal perspectives,” Telematics and Informatics , vol. 82, p. 102013, 2023
2023
S. D’Angelo, A. Murillo, S. Chandra, and A. Macvean, “What do developers want from ai?” IEEE Software , vol. 41, no. 3, pp. 11–15, 2024
2024
Closest in time.
J. T. Liang, C. Yang, and B. A. Myers, “A large-scale survey on the usability of ai programming assistants: Successes and challenges,” in Proceedings of the IEEE/ACM 46th International Conference on Software Engineering , 2024
2024
Closest in time.
2024
Closest in time.
R. Wang, R. Cheng, D. Ford, and T. Zimmermann, “Investigating and designing for trust in ai-powered code generation tools,” in Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency , 2024, p. 1475–1493
2024
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
B. G. Edelman, J. Bono, S. Peng, R. Rodriguez, and S. Ho, “Randomized controlled trial for microsoft security copilot,” Available at SSRN 4648700 , 2023
2023
Cited alongside, same era.
B. Zhang, P. Liang, X. Zhou, A. Ahmad, and M. Waseem, “Practices and challenges of using github copilot: An empirical study,” in Proceedings of the 35th International Conference on Software Engineering and Knowledge Engineering , vol. 2023, jul 2023, p. 124–129
2023
Cited alongside, same era.
C. Thorbecke, “A year after ChatGPT’s release, the AI revolution is just beginning,” https://www.cnn.com/2023/11/30/tech/chatgpt-openai-revolution-one-year/index.html
2024
Cited alongside, same era.
“Copilot,” https://github.com/features/copilot
2024
Cited alongside, same era.
“Alphacode,” https://alphacode.deepmind.com/
2024
Cited alongside, same era.
“Codewhisperer,” https://docs.aws.amazon.com/codewhisperer/latest/userguide/what-is-cwspr.html
2024
Cited alongside, same era.
“Tabnine,” https://www.tabnine.com/
2024
Cited alongside, same era.
“Cursor,” https://www.cursor.com/
2024
Cited alongside, same era.
A. Brown, S. D’Angelo, A. Murillo, C. Jaspan, and C. Green, “Identifying the factors that influence trust in ai code completion,” in Proceedings of the 1st ACM International Conference on AI-Powered Software , 2024, pp. 1–9
2024
Closest in time.
T. Weber, M. Brandmaier, A. Schmidt, and S. Mayer, “Significant productivity gains through programming with large language models,” Proceedings of the ACM on Human-Computer Interaction , vol. 8, no. EICS, pp. 1–29, 2024
2024
Closest in time.
V. S. Code, “Visual studio code,” https://code.visualstudio.com/
2024
Closest in time.
M. Tabachnyk, “Ml-enhanced code completion improves developer productivity,” https://research.google/blog/ml-enhanced-code-completion-improves-developer-productivity/
2024
Closest in time.
O. Dunay, D. Cheng, A. Tait, P. Thakkar, P. C. Rigby, A. Chiu, I. Ahmad, A. Ganesan, C. Maddila, V. Murali et al. , “Multi-line ai-assisted code authoring,” in Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering , 2024, pp. 150–160
2024
Closest in time.
S. Forte, “Smart paste for context-aware adjustments to pasted code,” https://research.google/blog/smart-paste-for-context-aware-adjustments-to-pasted-code/
2024
Closest in time.
CoderPad, “Coderpad state of tech hiring,” https://coderpad.io/survey-reports/coderpad-and-codingame-state-of-tech-hiring-2024/
2024
Closest in time.
J. T. I. Lab, “Jetbrains the state of developer ecosystem 2023,” https://www.jetbrains.com/lp/devecosystem-2023/
2024
Closest in time.
L.-M. Neudert, A. Knuutila, and P. N. Howard, “Global attitudes towards ai, machine learning & automated decision making–implications for involving artificial intelligence in public service and good governance,” https://perma.cc/6PB6-X56B
2024
Closest in time.
H. Mozannar, G. Bansal, A. Fourney, and E. Horvitz, “Reading between the lines: Modeling user behavior and costs in ai-assisted programming,” in Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems , New York, NY, USA, 2024
2024
Closest in time.
2024
Closest in time.
W. Harding and M. Kloster, “Coding on copilot: 2023 data suggests downward pressure on code quality,” https://www.gitclear.com/coding_on_copilot_data_shows_ais_downward_pressure_on_code_quality/
2024
Closest in time.