ChatGPT as a Math Questioner? Evaluating ChatGPT on Generating Pre-university Math Questions

Understand

Mathematical questioning is crucial for assessing students problem-solving skills.

• Since manually creating such questions requires substantial effort, automatic methods have been explored.
• Existing state-of-the-art models rely on fine-tuning strategies and struggle to generate questions that heavily involve multiple steps of logical and arithmetic reasoning.
• Meanwhile, large language models(LLMs) such as ChatGPT have excelled in many NLP tasks involving logical and arithmetic reasoning.