ChatGPT, Can You Generate Solutions for my Coding Exercises? An Evaluation on its Effectiveness in an undergraduate Java Programming Course

Understand

In this study, we assess the efficacy of employing the ChatGPT language model to generate solutions for coding exercises within an undergraduate Java programming course.

• ChatGPT, a large-scale, deep learning-driven natural language processing model, is capable of producing programming code based on textual input.
• Our evaluation involves analyzing ChatGPT-generated solutions for 80 diverse programming exercises and comparing them to the correct solutions.
• Our findings indicate that ChatGPT accurately generates Java programming solutions, which are characterized by high readability and well-structured organization.