Fetching the paper…
Reading the bibliography…
This article explores the natural language generation capabilities of large language models with application to the production of two types of learning resources common in programming courses.
Language Models are Few-Shot Learners. In Advances in neural information processing systems . 1877–1901
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 1901
Earlier work this paper cites.
An algorithm for an automatic general polynomial solver
MA Jenkins and Joseph Frederick Traub. 1967 · 1967
Earlier work this paper cites.
Self-efficacy: toward a unifying theory of behavioral change
Albert Bandura. 1977 · 1977
Earlier work this paper cites.
Mind in society: Development of higher psychological processes
Lev Semenovich Vygotsky and Michael Cole. 1978 · 1978
Earlier work this paper cites.
Evaluating the quality of learning : the SOLO taxonomy (structure of the observed learning outcome) / John B. Biggs, Kevin F. Collis
John B. Biggs and K. F. Collis. 1982 · 1982
Earlier work this paper cites.
Empirical studies of programming knowledge
Elliot Soloway and Kate Ehrlich. 1984 · 1984
Earlier work this paper cites.
Conditions of Learning in Novice Programmers
D. N. Perkins, Chris Hancock, Renee Hobbs, Fay Martin, and Rebecca Simmons. 1986 · 1986
Earlier work this paper cites.
Learning to Program = Learning to Construct Mechanisms and Explanations
E. Soloway. 1986 · 1986
Earlier work this paper cites.
The role of deliberate practice in the acquisition of expert performance
K Anders Ericsson, Ralf T Krampe, and Clemens Tesch-Römer. 1993 · 1993
Earlier work this paper cites.
Strengthening the case for pair programming
Laurie Williams, Robert R Kessler, Ward Cunningham, and Ron Jeffries. 2000 · 2000
Earlier work this paper cites.
Peer instruction: Ten years of experience and results
Catherine H Crouch and Eric Mazur. 2001 · 2001
Earlier work this paper cites.
A Multi-National Study of Reading and Tracing Skills in Novice Programmers. In Working Group Reports from ITiCSE on Innovation and Technology in Computer Science Education (Leeds, United Kingdom) (ITiCSE-WGR ’04) . Association for Computing Machinery, New York, NY, USA, 119–150
Raymond Lister, Elizabeth S. Adams, Sue Fitzgerald, William Fone, John Hamer, Morten Lindholm, Robert McCartney, Jan Erik Moström, Kate Sanders, Otto Seppälä, Beth Simon, and Lynda Thomas. 2004 · 2004
Earlier work this paper cites.
A survey of automated assessment approaches for programming assignments
Kirsti M Ala-Mutka. 2005 · 2005
Earlier work this paper cites.
Signature pedagogies in the professions
Lee S Shulman. 2005 · 2005
Earlier work this paper cites.
A surprising effect of feedback on learning
Regina Vollmeyer and Falko Rheinberg. 2005 · 2005
Earlier work this paper cites.
Not Seeing the Forest for the Trees: Novice Programmers and the SOLO Taxonomy
Raymond Lister, Beth Simon, Errol Thompson, Jacqueline L. Whalley, and Christine Prasad. 2006 · 2006
Earlier work this paper cites.
An Australasian Study of Reading and Comprehension Skills in Novice Programmers, Using the Bloom and SOLO Taxonomies. In Proceedings of the 8th Australasian Conference on Computing Education - Volume 52 (Hobart, Australia) (ACE ’06) . Australian Computer Society, Inc., AUS, 243–252
Jacqueline L. Whalley, Raymond Lister, Errol Thompson, Tony Clear, Phil Robbins, P. K. Ajith Kumar, and Christine Prasad. 2006 · 2006
Earlier work this paper cites.
The power of feedback
John Hattie and Helen Timperley. 2007 · 2007
Earlier work this paper cites.
Developing a Common Format for Sharing Programming Assignments
Stephen H. Edwards, Jürgen Börstler, Lillian N. Cassel, Mark S. Hall, and Joseph Hollingsworth. 2008 · 2008
Earlier work this paper cites.
Debugging: a review of the literature from an educational perspective
Renée McCauley, Sue Fitzgerald, Gary Lewandowski, Laurie Murphy, Beth Simon, Lynda Thomas, and Carol Zander. 2008 · 2008
Earlier work this paper cites.
Going SOLO to Assess Novice Programmers. In Proceedings of the 13th Annual Conference on Innovation and Technology in Computer Science Education (Madrid, Spain) (ITiCSE ’08) . Association for Computing Machinery, New York, NY, USA, 209–213
Judy Sheard, Angela Carbone, Raymond Lister, Beth Simon, Errol Thompson, and Jacqueline L. Whalley. 2008 · 2008
Earlier work this paper cites.
Focus on formative feedback
Valerie J Shute. 2008 · 2008
Earlier work this paper cites.
Further Evidence of a Relationship between Explaining, Tracing and Writing Skills in Introductory Programming
Raymond Lister, Colin Fidge, and Donna Teague. 2009 · 2009
Earlier work this paper cites.
A Closer Look at Tracing, Explaining and Code Writing Skills in the Novice Programmer. In Proceedings of the Fifth International Workshop on Computing Education Research Workshop (Berkeley, CA, USA) (ICER ’09) . Association for Computing Machinery, New York, NY, USA, 117–128
Anne Venables, Grace Tan, and Raymond Lister. 2009 · 2009
Earlier work this paper cites.
Review of recent systems for automatic assessment of programming assignments. In Proceedings of the 10th Koli calling international conference on computing education research . 86–93
Petri Ihantola, Tuukka Ahoniemi, Ville Karavirta, and Otto Seppälä. 2010 · 2010
Earlier work this paper cites.
An analysis and survey of the development of mutation testing
Yue Jia and Mark Harman. 2010 · 2010
Earlier work this paper cites.
Codewrite: supporting student-driven practice of java. In Proceedings of the 42nd ACM technical symposium on Computer science education . 471–476
Paul Denny, Andrew Luxton-Reilly, Ewan Tempero, and Jacob Hendrickx. 2011 · 2011
Earlier work this paper cites.
Pair programming in education: a literature review
Brian Hanks, Sue Fitzgerald, Renée McCauley, Laurie Murphy, and Carol Zander. 2011 · 2011
Earlier work this paper cites.
Extreme apprenticeship method in teaching programming for beginners. In Proceedings of the 42nd ACM technical symposium on Computer science education . 93–98
Arto Vihavainen, Matti Paksula, and Matti Luukkainen. 2011 · 2011
Earlier work this paper cites.
Ability to ’explain in Plain English’ Linked to Proficiency in Computer-Based Programming. In Proceedings of the Ninth Annual International Conference on International Computing Education Research (Auckland, New Zealand) (ICER ’12) . Association for Computing Machinery, New York, NY, USA, 111–118
Laurie Murphy, Sue Fitzgerald, Raymond Lister, and Renée McCauley. 2012 · 2012
Earlier work this paper cites.
True grit
Angela Lee Duckworth and Lauren Eskreis-Winkler. 2013 · 2013
Earlier work this paper cites.
CloudCoder: Building a Community for Creating, Assigning, Evaluating and Sharing Programming Exercises (Abstract Only). In Proceeding of the 44th ACM Technical Symposium on Computer Science Education (Denver, Colorado, USA) (SIGCSE ’13) . Association for Computing Machinery, New York, NY, USA, 742
David Hovemeyer, Matthew Hertz, Paul Denny, Jaime Spacco, Andrei Papancea, John Stamper, and Kelly Rivers. 2013 · 2013
Cited alongside, same era.
Making Instructions for Others: Exploring Mental Models through a Simple Exercise
Robert Phillips, Dan Lockton, Sharon Baurley, and Sarah Silve. 2013 · 2013
Cited alongside, same era.
The Canterbury QuestionBank: Building a repository of multiple-choice CS1 and CS2 questions. In Proceedings of the ITiCSE working group reports conference on Innovation and technology in computer science education-working group reports . 33–52
Kate Sanders, Marzieh Ahmadzadeh, Tony Clear, Stephen H Edwards, Mikey Goldweber, Chris Johnson, Raymond Lister, Robert McCartney, Elizabeth Patitsas, and Jaime Spacco. 2013 · 2013
Cited alongside, same era.
The recurring rainfall problem. In Proceedings of the tenth annual conference on International computing education research . 35–42
Harnessing the Wisdom of the Classes: Classsourcing and Machine Learning for Assessment Instrument Generation. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (Minneapolis, MN, USA) (SIGCSE ’19) . Association for Computing Machinery, New York, NY, USA, 606–612
Sam Saarinen, Shriram Krishnamurthi, Kathi Fisler, and Preston Tunnell Wilson. 2019 · 2019
Later among the works it cites.
A Theory of Instruction for Introductory Programming Skills
Benjamin Xie, Dastyni Loksa, Greg L. Nelson, Matthew J. Davidson, Dongsheng Dong, Harrison Kwik, Alex Hui Tan, Leanne Hwa, Min Li, and Amy J. Ko. 2019 · 2019
Later among the works it cites.
Lisa Yan, Annie Hu, and Chris Piech. 2019 · 2019
Later among the works it cites.
A Validated Scoring Rubric for Explain-in-Plain-English Questions
Binglin Chen, Sushmita Azad, Rajarshi Haldar, Matthew West, and Craig Zilles. 2020 · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Kathi Fisler. 2014 · 2014
Cited alongside, same era.
A systematic review of approaches for teaching introductory programming and their influence on success. In Proceedings of the tenth annual conference on International computing education research . 19–26
Arto Vihavainen, Jonne Airaksinen, and Christopher Watson. 2014 · 2014
Cited alongside, same era.
Measuring the Effect of Inventing Practice Exercises on Learning in an Introductory Programming Course. In Proceedings of the 15th Koli Calling Conference on Computing Education Research (Koli, Finland) (Koli Calling ’15) . Association for Computing Machinery, New York, NY, USA, 13–22
Paul Denny, Diana Cukierman, and Jonathan Bhaskar. 2015 · 2015
Cited alongside, same era.
Learnersourcing: improving learning with collective learner activity
Juho Kim. 2015 · 2015
Cited alongside, same era.
Identification of programmers from typing patterns. In Proceedings of the 15th Koli Calling conference on computing education research . 60–67
Krista Longi, Juho Leinonen, Henrik Nygren, Joni Salmi, Arto Klami, and Arto Vihavainen. 2015 · 2015
Cited alongside, same era.
Do we know how difficult the rainfall problem is?. In Proceedings of the 15th Koli Calling Conference on Computing Education Research . 87–96
Otto Seppälä, Petri Ihantola, Essi Isohanni, Juha Sorva, and Arto Vihavainen. 2015 · 2015
Cited alongside, same era.
Typing patterns and authentication in practical programming exams. In Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education . 160–165
Juho Leinonen, Krista Longi, Arto Klami, Alireza Ahadi, and Arto Vihavainen. 2016 · 2016
Cited alongside, same era.
Coderunner: A Tool for Assessing Computer Programming Skills
Richard Lobb and Jenny Harlow. 2016 · 2016
Cited alongside, same era.
AXIS: Generating Explanations at Scale with Learnersourcing and Machine Learning. In Proceedings of the Third (2016) ACM Conference on Learning @ Scale (Edinburgh, Scotland, UK) (L@S ’16) . Association for Computing Machinery, New York, NY, USA, 379–388
Joseph Jay Williams, Juho Kim, Anna Rafferty, Samuel Maldonado, Krzysztof Z. Gajos, Walter S. Lasecki, and Neil Heffernan. 2016 · 2016
Cited alongside, same era.
A review of research on Parsons problems. In Proceedings of the Twenty-Second Australasian Computing Education Conference . 195–202
Yuemeng Du, Andrew Luxton-Reilly, and Paul Denny. 2020 · 2020
Later among the works it cites.
Syntax exercises in CS1. In Proceedings of the 2020 ACM Conference on International Computing Education Research . 216–226
John Edwards, Joseph Ditton, Dragan Trninic, Hillary Swanson, Shelsey Sullivan, and Chad Mano. 2020 · 2020
Later among the works it cites.
CodeBERT: A pre-trained model for programming and natural languages
Zhangyin Feng, Daya Guo, Duyu Tang, Nan Duan, Xiaocheng Feng, Ming Gong, Linjun Shou, Bing Qin, Ting Liu, Daxin Jiang, et al · 2020
Later among the works it cites.
Misconception-Based Peer Feedback: A Pedagogical Technique for Reducing Misconceptions. In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education (Trondheim, Norway) (ITiCSE ’20) . Association for Computing Machinery, New York, NY, USA, 166–172
Cazembe Kennedy, Aubrey Lawson, Yvon Feaster, and Eileen Kraemer. 2020 · 2020
Later among the works it cites.
Crowdsourcing Content Creation for SQL Practice. In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education . 349–355
Juho Leinonen, Nea Pirttinen, and Arto Hellas. 2020 · 2020
Later among the works it cites.
On the Cognitive Development of the Novice Programmer: And the Development of a Computing Education Researcher. In Proceedings of the 9th Computer Science Education Research Conference (Virtual Event, Netherlands) (CSERC ’20) . Association for Computing Machinery, New York, NY, USA, Article 2, 15 pages
Raymond Lister. 2020 · 2020
Later among the works it cites.
Unlimited Trace Tutor: Learning Code Tracing With Automatically Generated Programs
Ruixiang Qi and Davide Fossati. 2020 · 2020
Later among the works it cites.
STOP THE (AUTOGRADER) INSANITY: Regression Penalties to Deter Autograder Overreliance. In Proceedings of the 52nd ACM Technical Symposium on Computer Science Education (Virtual Event, USA) (SIGCSE ’21) . Association for Computing Machinery, New York, NY, USA, 1062–1068
Elisa Baniassad, Lucas Zamprogno, Braxton Hall, and Reid Holmes. 2021 · 2021
Later among the works it cites.
Evaluating large language models trained on code
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al · 2021
Later among the works it cites.
A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Level
Iddo Drori, Sarah Zhang, Reece Shuttleworth, Leonard Tang, Albert Lu, Elizabeth Ke, Kevin Liu, Linda Chen, Sunny Tran, Newman Cheng, Roman Wang, Nikhil Singh, Taylor L. Patti, Jayson Lynch, Avi Shporer, Nakul Verma, Eugene Wu, and Gilbert Strang. 2021 · 2021
Later among the works it cites.
Cognitive Load Theory in Computing Education Research: A Review
Rodrigo Duran, Albina Zavgorodniaia, and Juha Sorva. 2021 · 2021
Later among the works it cites.
Autograding "Explain in Plain English" Questions Using NLP. In Proceedings of the 52nd ACM Technical Symposium on Computer Science Education (Virtual Event, USA) (SIGCSE ’21) . Association for Computing Machinery, New York, NY, USA, 1163–1169
Max Fowler, Binglin Chen, Sushmita Azad, Matthew West, and Craig Zilles. 2021 · 2021
Later among the works it cites.
Exploring ‘Reverse-Tracing’ Questions as a Means of Assessing the Tracing Skill on Computer-Based CS 1 Exams. In Proceedings of the 17th ACM Conference on International Computing Education Research (Virtual Event, USA) (ICER 2021) . Association for Computing Machinery, New York, NY, USA, 115–126
Mohammed Hassan and Craig Zilles. 2021 · 2021
Later among the works it cites.
Let’s Ask Students About Their Programs, Automatically. In 2021 IEEE/ACM 29th International Conference on Program Comprehension (ICPC) . IEEE, 467–475
Teemu Lehtinen, André L Santos, and Juha Sorva. 2021 · 2021
Later among the works it cites.
Exploring the Effects of Contextualized Problem Descriptions on Problem Solving. In Australasian Computing Education Conference (Virtual, SA, Australia) (ACE ’21) . Association for Computing Machinery, New York, NY, USA, 30–39
Juho Leinonen, Paul Denny, and Jacqueline Whalley. 2021 · 2021
Later among the works it cites.
Can OpenAI Codex and Other Large Language Models Help Us Fix Security Bugs?
Hammond Pearce, Benjamin Tan, Baleegh Ahmad, Ramesh Karri, and Brendan Dolan-Gavitt. 2021 · 2021
Later among the works it cites.
What’s In It for the Learners? Evidence from a Randomized Field Experiment on Learnersourcing Questions in a MOOC. In Proceedings of the Eighth ACM Conference on Learning@ Scale . 221–233
Anjali Singh, Christopher Brooks, Yiwen Lin, and Warren Li. 2021 · 2021
Later among the works it cites.
The Self-Taught Programmer: The Definitive Guide to Programming Professionally
Cory Althoff. 2022 · 2022
Closest in time.
Matteo Ciniselli, Luca Pascarella, and Gabriele Bavota. 2022 · 2022
Closest in time.
The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Australasian Computing Education Conference . 10–19
James Finnie-Ansley, Paul Denny, Brett A Becker, Andrew Luxton-Reilly, and James Prather. 2022 · 2022
Closest in time.
Large Language Models are Zero-Shot Reasoners
Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022 · 2022
Closest in time.
A Comparison of Immediate and Scheduled Feedback in Introductory Programming Projects. In Proceedings of the 53rd ACM Technical Symposium on Computer Science Education V. 1 (Providence, RI, USA) (SIGCSE 2022) . Association for Computing Machinery, New York, NY, USA, 885–891
Juho Leinonen, Paul Denny, and Jacqueline Whalley. 2022 · 2022
Closest in time.
Competition-Level Code Generation with AlphaCode
Yujia Li, David Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, et al · 2022
Closest in time.
Automated Assessment in Computer Science Education: A State-of-the-Art Review
José Carlos Paiva, José Paulo Leal, and Álvaro Figueira. 2022 · 2022
Closest in time.
Pop Quiz! Can a Large Language Model Help With Reverse Engineering?
Hammond Pearce, Benjamin Tan, Prashanth Krishnamurthy, Farshad Khorrami, Ramesh Karri, and Brendan Dolan-Gavitt. 2022 · 2022
Closest in time.
Can Students Review Their Peers? Comparison of Peer and Instructor Reviews. In Proceedings of the 27th ACM Conference on Innovation and Technology in Computer Science Education Vol 1
Nea Pirttinen and Juho Leinonen. 2022 · 2022
Closest in time.
Large pre-trained language models contain human-like biases of what is right and wrong to do
Patrick Schramowski, Cigdem Turan, Nico Andersen, Constantin A Rothkopf, and Kristian Kersting. 2022 · 2022
Closest in time.