Fetching the paper…
Reading the bibliography…
Large language models (LLMs) are becoming increasingly better at a wide range of Natural Language Processing tasks (NLP), such as text generation and understanding.
Guidelines for performing systematic literature reviews in software engineering
B. A. Kitchenham and S. Charters · 2007
Earlier work this paper cites.
Language models are few-shot learners
T. Brown, B. Mann, et al · 2020
Earlier work this paper cites.
Codebert: A pre-trained model for programming and natural languages
Z. Feng, D. Guo, et al · 2020
Earlier work this paper cites.
Evaluating large language models trained on code
Mark Chen, Jerry Tworek, et al · 2021
Earlier work this paper cites.
Automatic generation of programming exercises and code explanations using large language models
S. Sarsa, P. Denny, A. Hellas, and J. Leinonen · 2022
Earlier work this paper cites.
Conversing with copilot: Exploring prompt engineering for solving cs1 problems using natural language
P. Denny, V. Kumar, and N. Giacaman · 2023
Earlier work this paper cites.
OpenAI · 2023
Earlier work this paper cites.
Generative ai for programming education: Benchmarking chatgpt, gpt-4, and human tutors, 2023
T. Phung, Victor-Alexandru, et al · 2023
Earlier work this paper cites.
Ai-ta: Towards an intelligent question-answer teaching assistant using open-source llms, 2023
Yann Hicke, Anmol Agarwal, Qianou Ma, and Paul Denny · 2023
Earlier work this paper cites.
Chatgpt and large language models in academia: opportunities and challenges
J. Meyer, R. Urbanowicz, et al · 2023
Earlier work this paper cites.
Large language models (gpt) for automating feedback on programming assignments, 2023
M. Pankiewicz and R. S. Baker · 2023
Earlier work this paper cites.
Survey reveals AI’s impact on the developer experience | | The GitHub Blog
Inbal Shani · 2023
Earlier work this paper cites.
Large language models for software engineering: Survey and open problems
A. Fan, B. Gokkaya, M. Harman, M. Lyubarskiy, S. Sengupta, S. Yoo, and J. Zhang · 2023
Earlier work this paper cites.
Can chatgpt play the role of a teaching assistant in an introductory programming course?, 2023
Anishka and A. Mehta · 2023
Earlier work this paper cites.
Ai-enhanced auto-correction of programming exercises: How effective is gpt-3.5?
I. Azaiz, O. Deckarm, and S. Strickroth · 2023
Earlier work this paper cites.
Programming is hard - or at least it used to be: Educational opportunities and challenges of ai code generation
B. A. Becker, P. Denny, and J. Finnie-Ansley · 2023
Earlier work this paper cites.
Recommendations to create programming exercises to overcome chatgpt
J. Berrezueta-Guzman and S. Krusche · 2023
Earlier work this paper cites.
Scaffolding cs1 courses with a large language model-powered intelligent tutoring system
C. Cao · 2023
Earlier work this paper cites.
Qualitative research methods for large language models: Conducting semi-structured interviews with chatgpt and bard on computer science education
A. Dengel, R. Gehrlein, and D. Fernes · 2023
Earlier work this paper cites.
From human days to machine seconds: Automatically answering and generating machine learning final exams
I. Drori, S. J. Zhang, R. Shuttleworth, and S. Zhang · 2023
Earlier work this paper cites.
Exploring the potential of large language models in generating code-tracing questions for introductory programming courses
A. Fan and H. Zhang · 2023
Earlier work this paper cites.
Prompting Large Language Models to Power Educational Chatbots
J. Carlos Farah, S. Ingram, B. Spaenlehauer, F. Kim-Lan Lasne, and D. Gillet · 2023
Earlier work this paper cites.
Studying the effect of ai code generators on supporting novice learners in introductory programming
M. Kazemitabaar, J. Chow, and C. Ka To Ma · 2023
Earlier work this paper cites.
Large language models in introductory programming education: Chatgpt’s performance and implications for assessments, 2023
N. Kiesler and D. Schiffner · 2023
Earlier work this paper cites.
Training Language Models for Programming Feedback Using Automated Repair Tools
C. Koutcheme · 2023
Earlier work this paper cites.
Kogi: A seamless integration of chatgpt into jupyter environments for programming education
K. Kuramitsu, Y. Obara, M. Sato, and M. Obara · 2023
Earlier work this paper cites.
From "ban it till we understand it" to "resistance is futile": How university programming instructors plan to adapt as more students use ai code generation and explanation tools such as chatgpt and github copilot
S. Lau and P. Guo · 2023
Earlier work this paper cites.
Comparing code explanations created by students and large language models
J. Leinonen, P. Denny, and S. MacNeil · 2023
Earlier work this paper cites.
Evaluating the impact of chatgpt on exercises of a software security course, 2023
J. Li and P. Håkon Meland · 2023
Earlier work this paper cites.
The potential of large language models as tools for analyzing student textual evaluation: A differential analysis between cs and non-cs students
H. Li · 2023
Earlier work this paper cites.
Experiences from using code explanations generated by large language models in a web software development e-book
S. MacNeil, A. Tran, and A. Hellas · 2023
Earlier work this paper cites.
Detecting llm-generated text in computing education: A comparative study for chatgpt cases, 2023
M. Sheinman Orenstrakh, O. Karnalim, C. Anibal Suarez, and M. Liut · 2023
Earlier work this paper cites.
Evaluating a large language model’s ability to solve programming exercises from an introductory bioinformatics course
S. R. Piccolo and P. Denny · 2023
Earlier work this paper cites.
The robots are here: Navigating the generative ai revolution in computing education
J. Prather, P. Denny, J. Leinonen, B. A. Becker, I. Albluwi, M. Craig, H. Keuning, N. Kiesler, T. Kohn, A. Luxton-Reilly, S. MacNeil, A. Petersen, R. Pettit, B. N. Reeves, and J. Savelka · 2023
Earlier work this paper cites.
Chatgpt in computer science curriculum assessment: An analysis of its successes and shortcomings
B. Qureshi · 2023
Earlier work this paper cites.
"call me kiran" – chatgpt as a tutoring chatbot in a computer science course
J. Rajala, J. Hukkanen, M. Hartikainen, and P. Niemelä · 2023
Earlier work this paper cites.
Assessing ChatGPT’s Proficiency in CS1-Level Problem Solving
M. Sánchez and A. Herrera · 2023
Earlier work this paper cites.
Efficient classification of student help requests in programming courses using large language models, 2023
J. Savelka, P. Denny, M. Liffiton, and B. Sheese · 2023
Earlier work this paper cites.
Exgen: Ready-to-use exercise generation in introductory programming courses
N. Binh Duong TA, H. Gia Phuc NGUYEN, and G. Swapna · 2023
Earlier work this paper cites.
Generating multiple choice questions for computing courses using large language models
A. Tran, K. Angelikas, E. Rama, and C. Okechukwu · 2023
Earlier work this paper cites.
What should data science education do with large language models
X. Tu, J. Zou, W. J Su, and L. Zhang · 2023
Earlier work this paper cites.
Evaluating copilot on cs1 code writing problems with suppressed specifications
V. Venkatesh, V. Venkatesh, and V. Kumar · 2023
Earlier work this paper cites.
Exploring the role of ai assistants in computer science education: Methods, implications, and instructor perspectives
T. Wang and D. Díaz · 2023
Earlier work this paper cites.
Generative ai in computing education: Perspectives of students and instructors
C. Zastudil and M. and Rogalska · 2023
Earlier work this paper cites.
Students’ perceptions and preferences of generative artificial intelligence feedback for programming, 2023
Z. Zhang and Z. Dong · 2023
Earlier work this paper cites.
Chatgpt and software testing education: Promises & perils
S. Jalil, S. Rafi, T. D. LaToza, K. Moran, and W. Lam · 2023
Earlier work this paper cites.
Chatgpt for teaching and learning: An experience from data science education
Y. Zheng · 2023
Cited alongside, same era.
Studenteval: A benchmark of student-written prompts for large language models of code, 2023
H. McLean Babe, S. Nguyen, and Y. Zi · 2023
Cited alongside, same era.
J. Achiam, S. Adler, S. Agarwal, et al · 2023
Cited alongside, same era.
Starcoder: may the source be with you!
R. Li, L. B. Allal, Y. Zi, N. Muennighoff, D. Kocetkov, C. Mou, M. Marone, C. Akiki, J. Li, J. Chim, et al · 2023
Cited alongside, same era.
Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, et al · 2023
Cited alongside, same era.
Computer science education in chatgpt era: Experiences from an experiment in a programming course for novice programmers
T. Kosar, D. Ostojić, Y. David Liu, and M. Mernik · 2024
Closest in time.
Performance of large language models in a computer science degree program
T. Krüger and M. Gref · 2024
Closest in time.
Using large language models for student-code guided test case generation in computer science education, 2024
N. Ashok Kumar and A. Lan · 2024
Closest in time.
Codehelp: Using large language models with guardrails for scalable support in programming classes
M. Liffiton, B. E Sheese, J. Savelka, and P. Denny · 2024
Closest in time.
Beyond traditional teaching: Large language models as simulated teaching assistants in computer science
M. Liu and F. M’Hiri · 2024
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
The refinedweb dataset for falcon llm: Outperforming curated corpora with web data, and web data only, 2023
G. Penedo, Q. Malartic, and D. Hesslow · 2023
Cited alongside, same era.
Mpt-30b: Raising the bar for open-source foundation models, 2023
The MosaicML NLP Team · 2023
Cited alongside, same era.
"the teachers are confused as well": A multiple-stakeholder ethics discussion on large language models in computing education, 2024
K. Z. Zhou, Z. Kilhoffer, et al · 2024
Cited alongside, same era.
An exploratory study on upper-level computing students’ use of large language models as tools in a semester-long project, 2024
B. Arie Tanay, L. Arinze, S. S. Joshi, K. A. Davis, and J. C. Davis · 2024
Cited alongside, same era.
Impact of guidance and interaction strategies for llm use on learner performance and perception, 2024
Harsh Kumar, Ilya Musabirov, et al · 2024
Cited alongside, same era.
“it’s not like jarvis, but it’s pretty close!” - examining chatgpt’s usage among undergraduate students in computer science
R. Budhiraja, I. Joshi, et al · 2024
Cited alongside, same era.
A survey on large language model (llm) security and privacy: The good, the bad, and the ugly
Y. Yao, J. Duan, K. Xu, Y. Cai, Z. Sun, and Y. Zhang · 2024
Cited alongside, same era.
Teaching cs50 with ai: Leveraging generative artificial intelligence in computer science education
R. Liu, C. Zenke, and C. Liu · 2024
Closest in time.
Evaluating the effectiveness of llms in introductory computer science education: A semester-long field study
W. Lyu, Y. Wang, T. Rachel Chung, Y. Sun, and Y. Zhang · 2024
Closest in time.
How to teach programming in the ai era? using llms as a teachable agent for debugging
Q. Ma, H. Shen, K. Koedinger, and S. Wu · 2024
Closest in time.
Examining student use of ai in cs1 and cs2
E. D. Manley, T. Urness, A. Migunov, and M. Alimoor Reza · 2024
Closest in time.
Evaluating chatgpt-4 vision on brazil’s national undergraduate computer science exam
N. C. Mendonça · 2024
Closest in time.
How beginning programmers and code llms (mis)read each other
S. Nguyen, H. McLean Babe, Y. Zi, A. Guha, C. Jane Anderson, and M. Q Feldman · 2024
Closest in time.
Automated assessment of students’ code comprehension using llms, 2024
P. Oli, R. Banjade, J. Chapagain, and V. Rus · 2024
Closest in time.
Beyond the hype: A cautionary tale of chatgpt in the programming classroom, 2024
G. Oosterwyk, P. Tsibolane, P. Kautondokwa, and A. Canani · 2024
Closest in time.
Insights from social shaping theory: The appropriation of large language models in an undergraduate programming course
A. Padiyath, X. Hou, A. Pang, D. Viramontes Vargas, X. Gu, T. Nelson-Fromm, Z. Wu, M. Guzdial, and B. Ericson · 2024
Closest in time.
A large language model approach to educational survey feedback analysis
M. J. Parker, C. Anderson, C. Stone, and Y. Oh · 2024
Closest in time.
Integrating llms into database systems education
K. Prakash, S. Rao, R. Hamza, J. Lukich, V. Chaudhari, and A. Nandi · 2024
Closest in time.
Interactions with prompt problems: A new way to teach programming with large language models, 2024
J. Prather, P. Denny, J. Leinonen, D. H. Smith, B. N. Reeves, S. MacNeil, B. A. Becker, A. Luxton-Reilly, T. Amarouche, and B. Kimmel · 2024
Closest in time.
Cseprompts: A benchmark of introductory computer science prompts
N. Raihan, D. Goswami, S. Sayara Chowdhury Puspo, C. Newman, T. Ranasinghe, and M. Zampieri · 2024
Closest in time.
An empirical study on usage and perceptions of llms in a software engineering project, 2024
S. Rasnayaka, G. Wang, R. Shariffdeen, and G. Neelakanta Iyer · 2024
Closest in time.
Bridging the Programming Skill Gap with ChatGPT: A Machine Learning Project with Business Students
M. Reiche and J. L. Leidner · 2024
Closest in time.
Analysis of chatgpt performance in computer engineering exams
R. Rodriguez-Echeverría, J. D. Gutiérrez, and J. M. Conejero · 2024
Closest in time.
Enhancing e-learning experience through embodied ai tutors in immersive virtual environments: A multifaceted approach for personalized educational adaptation
F. Sarshartehrani, E. Mohammadrezaei, M. Behravan, and D. Gracanin · 2024
Closest in time.
From gpt-3 to gpt-4: On the evolving efficacy of llms to answer multiple-choice questions for programming classes in higher education
J. Savelka, A. Agarwal, C. Bogart, and M. Sakr · 2024
Closest in time.
Analyzing chat protocols of novice programmers solving introductory programming tasks with chatgpt, 2024
A. Scholl, D. Schiffner, and N. Kiesler · 2024
Closest in time.
Can chatgpt pass a cs1 python course?
J. S. Sharpe, R. E. Dougherty, and S. J. Smith · 2024
Closest in time.
Patterns of student help-seeking when using a large language model-powered programming assistant
B. Sheese, M. Liffiton, J. Savelka, and P. Denny · 2024
Closest in time.
Automatic generation of multiple-choice questions for cs0 and cs1 curricula using large language models
T. Song, Q. Tian, Y. Xiao, and S. Liu · 2024
Closest in time.
Automated analysis of algorithm descriptions quality, through large language models
A. Sterbini and M. Temperini · 2024
Closest in time.
Acceptance and use of chatgpt in the academic community
A. Strzelecki, K. Cicha, M. Rizun, and P. Rutecka · 2024
Closest in time.
Cs1-llm: Integrating llms into cs1 instruction, 2024
A. Vadaparty, D. Zingaro, D. H. Smith, M. Padala, C. Alvarado, J. Gorson Benario, and L. Porter · 2024
Closest in time.
Automated program repair for introductory programming assignments
H. Wan, H. Luo, M. Li, and X. Luo · 2024
Closest in time.
Enhancing image comprehension for computer science visual question answering
H. Wang, P. Qiang, H. Tan, and J. Hu · 2024
Closest in time.
A qualitative assessment of chatgpt generated code in the computer science curriculum
J. Wolfer · 2024
Closest in time.
Qacp: An annotated question answering dataset for assisting chinese python programming learners, 2024
R. Xiao, L. Han, X. Zhou, J. Wang, N. Zong, and P. Zhang · 2024
Closest in time.
Assistant teaching system for computer hardware courses based on large language model
D. Zhang, Q. Cao, Y. Guo, and L. Wang · 2024
Closest in time.
Generative ai for data science 101: Coding without learning to code
J. Bien and G. Mukherjee · 2024
Closest in time.
Evaluation of llm tools for feedback generation in a course on concurrent programming
I. Estévez-Ayres, P. Callejo, and M. Ángel Hombrados-Herrera · 2024
Closest in time.
Dual-submission homework in parallel computer architecture: An exploratory study in the age of llms
E. F. Gehringer, J. George Wang, and S. Kumar Jilla · 2024
Closest in time.
Implications of chatgpt for data science education
Y. Shen and X. Ai · 2024
Closest in time.
Teaching ai to k-12 learners: Lessons, issues, and guidance
S. Grover · 2024
Closest in time.
How novices use llm-based code generators to solve cs1 coding tasks in a self-paced learning environment
M. Kazemitabaar and X. Hou · 2024
Closest in time.
Incorporating generative ai into software development education
O. Petrovska, L. Clift, F. Moller, and R. Pearsall · 2024
Closest in time.
Potentiality of generative ai tools in higher education: Evaluating chatgpt’s viability as a teaching assistant for introductory programming courses
Z. Ahmed, S. Sadat Shanto, and A. Islam Jony · 2024
Closest in time.
Next-step hint generation for introductory programming using large language models
L. Roest, H. Keuning, and J. Jeuring · 2024
Closest in time.
An empirical study on how large language models impact software testing learning
S. Mezzaro, A. Gambi, and G. Fraser · 2024
Closest in time.
Enhancing programming learning with llms: Prompt engineering and flipped interaction
B. Cowan, Y. Watanobe, and A. Shirafuji · 2024
Closest in time.