Fetching the paper…
Reading the bibliography…
Background and Context: Over the past year, large language models (LLMs) have taken the world by storm.
Language models are few-shot learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 1901
Earlier work this paper cites.
What do novices know about programming?
Elliot Soloway, Kate Ehrlich, Jeffrey G. Bonar, and Judith Greenspan. 1982 · 1982
Earlier work this paper cites.
Bug Catalogue: I
W. Lewis Johnson, Elliot Soloway, Benjamin Cutler, and Steven Draper. 1983 · 1983
Earlier work this paper cites.
Cognitive strategies and looping constructs: An empirical study
Elliot Soloway, Jeffrey G. Bonar, and Kate Ehrlich. 1983 · 1983
Earlier work this paper cites.
Novice mistakes: Are the folk wisdoms correct?
James C Spohrer and Elliot Soloway. 1986 · 1986
Earlier work this paper cites.
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber. 1997 · 1997
Earlier work this paper cites.
Determinants of help seeking: Relations between perceived reasons for classroom help-avoidance and help-seeking behaviors in an experimental context
Ruth Butler. 1998 · 1998
Earlier work this paper cites.
Why do some students avoid asking for help? An examination of the interplay among students’ academic efficacy, teachers’ social–emotional role, and the classroom goal structure
Allison M Ryan, Margaret H Gheen, and Carol Midgley. 1998 · 1998
Earlier work this paper cites.
Avoiding seeking help in the classroom: Who and why?
Allison M Ryan, Paul R Pintrich, and Carol Midgley. 2001 · 2001
Earlier work this paper cites.
Perceived achievement goal structure and college student help seeking
Stuart A Karabenick. 2004 · 2004
Earlier work this paper cites.
A survey of automated assessment approaches for programming assignments
Kirsti M Ala-Mutka. 2005 · 2005
Earlier work this paper cites.
Educational psychology: A contemporary approach
Gary D Borich Borich. 2005 · 2005
Earlier work this paper cites.
Automatic test-based assessment of programming: A review
Christopher Douce, David Livingstone, and James Orwell. 2005 · 2005
Earlier work this paper cites.
A first look at novice compilation behaviour using BlueJ
Matthew C Jadud. 2005 · 2005
Earlier work this paper cites.
Methods and tools for exploring novice compilation behaviour. In Proceedings of the second international workshop on Computing education research . 73–84
Matthew C Jadud. 2006 · 2006
Earlier work this paper cites.
Expertise reversal effect and its implications for learner-tailored instruction
Slava Kalyuga. 2007 · 2007
Earlier work this paper cites.
A detector for non-literal Java errors. In Proc. of the 10th Koli Calling Int. Conf. on Computing Education Research . ACM, 118–122
Thomas Dy and Ma Mercedes Rodrigo. 2010 · 2010
Earlier work this paper cites.
Review of recent systems for automatic assessment of programming assignments. In Proc. of the 10th Koli calling int. conf. on computing education research . 86–93
Petri Ihantola, Tuukka Ahoniemi, Ville Karavirta, and Otto Seppälä. 2010 · 2010
Earlier work this paper cites.
All Syntax Errors Are Not Equal. In Proc. of the 17th ACM Annual Conf. on Innovation and Technology in Computer Science Education (Haifa, Israel) (ITiCSE ’12) . ACM, NY, NY, USA, 75–80
Paul Denny, Andrew Luxton-Reilly, and Ewan Tempero. 2012 · 2012
Earlier work this paper cites.
Predicting performance in an introductory programming course by logging and analyzing student programming behavior. In 2013 IEEE 13th international conference on advanced learning technologies . IEEE, 319–323
Christopher Watson, Frederick WB Li, and Jamie L Godwin. 2013 · 2013
Earlier work this paper cites.
Neural machine translation by jointly learning to align and translate
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014 · 2014
Earlier work this paper cites.
Investigating novice programming mistakes: Educator beliefs vs. student data. In Proceedings of the tenth annual conference on International computing education research . 43–50
Neil CC Brown and Amjad Altadmri. 2014 · 2014
Earlier work this paper cites.
Automatically detectable indicators of programming assignment difficulty. In Proceedings of the 15th Annual Conference on Information technology education . 33–38
Petri Ihantola, Juha Sorva, and Arto Vihavainen. 2014 · 2014
Earlier work this paper cites.
Meaningful categorisation of novice programmer errors. In 2014 IEEE Frontiers in Education Conf. (FIE) Proc. IEEE, 1–8
Davin McCall and Michael Kölling. 2014 · 2014
Earlier work this paper cites.
Codewebs: scalable homework search for massive open online programming courses. In Proceedings of the 23rd international conference on World wide web . 491–502
Andy Nguyen, Christopher Piech, Jonathan Huang, and Leonidas Guibas. 2014 · 2014
Earlier work this paper cites.
Dropout rates of massive open online courses: behavioural patterns
Daniel FO Onah, Jane Sinclair, and Russell Boyatt. 2014 · 2014
Earlier work this paper cites.
How novices tackle their first lines of code in an ide: Analysis of programming session traces. In Proceedings of the 14th koli calling international conference on computing education research . 109–116
Arto Vihavainen, Juha Helminen, and Petri Ihantola. 2014 · 2014
Earlier work this paper cites.
Exploring machine learning methods to automatically identify students in need of assistance. In Proceedings of the eleventh annual international conference on international computing education research . 121–130
Alireza Ahadi, Raymond Lister, Heikki Haapala, and Arto Vihavainen. 2015 · 2015
Earlier work this paper cites.
37 million compilations: Investigating novice programming mistakes in large-scale student data. In Proc. of the 46th ACM Technical Symposium on Computer Science Education . 522–527
Amjad Altadmri and Neil CC Brown. 2015 · 2015
Earlier work this paper cites.
The normalized programming state model: Predicting student performance in computing courses based on programming behavior. In Proceedings of the eleventh annual international conference on international computing education research . 141–150
Adam S Carter, Christopher D Hundhausen, and Olusola Adesope. 2015 · 2015
Cited alongside, same era.
OverCode: Visualizing variation in student solutions to programming problems at scale
Elena L Glassman, Jeremy Scott, Rishabh Singh, Philip J Guo, and Robert C Miller. 2015 · 2015
Cited alongside, same era.
Educational data mining and learning analytics in programming: Literature review and case studies. In Proc. of the 2015 ITiCSE on Working Group Reports . ACM, 41–63
Petri Ihantola, Arto Vihavainen, Alireza Ahadi, Matthew Butler, Jürgen Börstler, Stephen H Edwards, Essi Isohanni, Ari Korhonen, Andrew Petersen, Kelly Rivers, et al · 2015
Cited alongside, same era.
An exploration of error quotient in multiple contexts. In Proceedings of the 15th Koli Calling Conference on Computing Education Research . 77–86
Andrew Petersen, Jaime Spacco, and Arto Vihavainen. 2015 · 2015
Cited alongside, same era.
The error landscape: Characterizing the mistakes of novice programmers. In Proceedings of the 50th ACM technical symposium on computer science education . 538–544
Rebecca Smith and Scott Rixner. 2019 · 2019
Later among the works it cites.
Adaptive immediate feedback can improve novice programming engagement and intention to persist in computer science. In Proceedings of the 2020 ACM conference on international computing education research . 194–203
Samiha Marwan, Ge Gao, Susan Fisk, Thomas W Price, and Tiffany Barnes. 2020 · 2020
Later among the works it cites.
Exploring Novice Programmers’ Homework Practices: Initial Observations of Information Seeking Behaviors. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education
Silvia Muller, Monica Babes-Vroman, Mary Emenike, and Thu D Nguyen. 2020 · 2020
Later among the works it cites.
StereoSet: Measuring stereotypical bias in pretrained language models
Moin Nadeem, Anna Bethke, and Siva Reddy. 2020 · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Do we know how difficult the rainfall problem is?. In Proc. of the 15th Koli Calling Conf. on Computing Education Research . 87–96
Otto Seppälä, Petri Ihantola, Essi Isohanni, Juha Sorva, and Arto Vihavainen. 2015 · 2015
Cited alongside, same era.
Benefits of self-explanation in introductory programming. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education . 284–289
Arto Vihavainen, Craig S Miller, and Amber Settle. 2015 · 2015
Cited alongside, same era.
A new metric to quantify repeated compiler errors for novice programmers. In Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education . 296–301
Brett A Becker. 2016 · 2016
Cited alongside, same era.
Programming, problem solving, and self-awareness: Effects of explicit guidance. In Proceedings of the 2016 CHI conference on human factors in computing systems . 1449–1461
Dastyni Loksa, Amy J Ko, Will Jernigan, Alannah Oleson, Christopher J Mendez, and Margaret M Burnett. 2016 · 2016
Cited alongside, same era.
Translating principles of effective feedback for students into the CS1 context
Claudia Ott, Anthony Robins, and Kerry Shephard. 2016 · 2016
Cited alongside, same era.
Novice Java programming mistakes: Large-scale data vs. educator beliefs
Neil CC Brown and Amjad Altadmri. 2017 · 2017
Cited alongside, same era.
Writing reusable code feedback at scale with mixed-initiative program synthesis. In Proceedings of the Fourth (2017) ACM Conference on Learning@ Scale . 89–98
Andrew Head, Elena Glassman, Gustavo Soares, Ryo Suzuki, Lucas Figueredo, Loris D’Antoni, and Björn Hartmann. 2017 · 2017
Cited alongside, same era.
Plagiarism in take-home exams: help-seeking, collaboration, and systematic cheating. In Proc. of the 2017 ACM conf. on innovation and technology in computer science education . 238–243
Arto Hellas, Juho Leinonen, and Petri Ihantola. 2017 · 2017
Cited alongside, same era.
On Designing Programming Error Messages for Novices: Readability and Its Constituent Factors. In Proc. of the 2021 CHI Conf. on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21) . Association for Computing Machinery, New York, NY,USA, Article 55, 15 pages
Paul Denny, James Prather, Brett A. Becker, Catherine Mooney, John Homer, Zachary C Albrecht, and Garrett B. Powell. 2021 · 2021
Later among the works it cites.
Programming Is Hard – Or at Least It Used to Be: Educational Opportunities And Challenges of AI Code Generation
Brett A. Becker, Paul Denny, James Finnie-Ansley, Andrew Luxton-Reilly, James Prather, and Eddie Antonio Santos. 2022 · 2022
Later among the works it cites.
Robosourcing Educational Resources–Leveraging Large Language Models for Learnersourcing
Paul Denny, Sami Sarsa, Arto Hellas, and Juho Leinonen. 2022b · 2022
Later among the works it cites.
The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Australasian Computing Education Conf. ACM, 10–19
James Finnie-Ansley, Paul Denny, Brett A. Becker, Andrew Luxton-Reilly, and James Prather. 2022 · 2022
Later among the works it cites.
Towards Giving Timely Formative Feedback and Hints to Novice Programmers. In Proceedings of the 2022 Working Group Reports on Innovation and Technology in Computer Science Education (ITiCSE-WGR ’22) . Association for Computing Machinery, New York, NY, USA, 95–115
Johan Jeuring, Hieke Keuning, Samiha Marwan, Dennis Bouvier, Cruz Izu, Natalie Kiesler, Teemu Lehtinen, Dominic Lohr, Andrew Peterson, and Sami Sarsa. 2022 · 2022
Later among the works it cites.
Survey of hallucination in natural language generation
Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Yejin Bang, Andrea Madotto, and Pascale Fung. 2022 · 2022
Later among the works it cites.
Evaluating CodeClusters for Effectively Providing Feedback on Code Submissions. In 2022 IEEE Frontiers in Education Conference (FIE) . IEEE, 1–9
Teemu Koivisto and Arto Hellas. 2022 · 2022
Later among the works it cites.
A Comparison of Immediate and Scheduled Feedback in Introductory Programming Projects. In Proc. of the 53rd ACM Technical Symposium on Computer Science Education V. 1 (Providence, RI, USA) (SIGCSE 2022) . ACM, New York, NY, USA, 885–891
Juho Leinonen, Paul Denny, and Jacqueline Whalley. 2022b · 2022
Later among the works it cites.
Piloting Natural Language Generation for Personalized Progress Feedback. In 2022 IEEE Frontiers in Education Conference (FIE) . IEEE, 1–8
Leo Leppänen, Arto Hellas, and Juho Leinonen. 2022 · 2022
Later among the works it cites.
Generating Diverse Code Explanations Using the GPT-3 Large Language Model. In Proc. of the 2022 ACM Conf. on Int. Computing Education Research - Volume 2 . ACM, 37–39
Stephen MacNeil, Andrew Tran, Dan Mogil, Seth Bernstein, Erin Ross, and Ziheng Huang. 2022 · 2022
Later among the works it cites.
Training language models to follow instructions with human feedback
Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al · 2022
Later among the works it cites.
Automated Assessment in Computer Science Education: A State-of-the-Art Review
José Carlos Paiva, José Paulo Leal, and Álvaro Figueira. 2022 · 2022
Later among the works it cites.
Automatic Generation of Programming Exercises and Code Explanations Using Large Language Models. In Proc. of the 2022 ACM Conf. on Int. Computing Education Research - Volume 1 . ACM, 27–43
Sami Sarsa, Paul Denny, Arto Hellas, and Juho Leinonen. 2022a · 2022
Later among the works it cites.
How to Help to Ask for Help? Help Request Prompt Structure Influence on Help Request Quantity and Course Retention. In 2022 IEEE Frontiers in Education Conference (FIE) . IEEE, 1–9
Sami Sarsa, Jesper Pettersson, and Arto Hellas. 2022b · 2022
Later among the works it cites.
Expectation vs. Experience: Evaluating the Usability of Code Generation Tools Powered by Large Language Models. In CHI Conf. on Human Factors in Computing Systems Extended Abstracts . 1–7
Priyan Vaithilingam, Tianyi Zhang, and Elena L Glassman. 2022 · 2022
Later among the works it cites.
Computing Education in the Era of Generative AI
Paul Denny, James Prather, Brett A Becker, James Finnie-Ansley, Arto Hellas, Juho Leinonen, Andrew Luxton-Reilly, Brent N Reeves, Eddie Antonio Santos, and Sami Sarsa. 2023 · 2023
Closest in time.
My AI Wants to Know if This Will Be on the Exam: Testing OpenAI’s Codex on CS2 Programming Exercises. In Proceedings of the 25th Australasian Computing Education Conference . 97–104
James Finnie-Ansley, Paul Denny, Andrew Luxton-Reilly, Eddie Antonio Santos, James Prather, and Brett A Becker. 2023 · 2023
Closest in time.
Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming
Majeed Kazemitabaar, Justin Chow, Carl Ka To Ma, Barbara J Ericson, David Weintrop, and Tovi Grossman. 2023 · 2023
Closest in time.
Comparing Code Explanations Created by Students and Large Language Models
Juho Leinonen, Paul Denny, Stephen MacNeil, Sami Sarsa, Seth Bernstein, Joanne Kim, Andrew Tran, and Arto Hellas. 2023a · 2023
Closest in time.
Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing
Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig. 2023 · 2023
Closest in time.
Automatically Generating CS Learning Materials with Large Language Models. In Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 2 (Toronto ON, Canada) (SIGCSE 2023) . Association for Computing Machinery, New York, NY, USA, 1176
Stephen MacNeil, Andrew Tran, Juho Leinonen, Paul Denny, Joanne Kim, Arto Hellas, Seth Bernstein, and Sami Sarsa. 2023b · 2023
Closest in time.
OpenAI. 2023 · 2023
Closest in time.
James Prather, Brent N Reeves, Paul Denny, Brett A Becker, Juho Leinonen, Andrew Luxton-Reilly, Garrett Powell, James Finnie-Ansley, and Eddie Antonio Santos. 2023 · 2023
Closest in time.
Michel Wermelinger. 2023 · 2023
Closest in time.