用规划+反思机制生成符合教育目标的数学题
From Objectives to Questions: A Planning-based Framework for Educational Mathematical Question Generation
- 基于蒙特卡洛树搜索与大模型结合,分步规划优化题目
- 在1.6万题数据集上,生成题目标匹配度显著提升
- 适合教育科技开发者和智能题库研究者
自动生成符合教育目标的高质量数学问题是自然语言处理在教育技术中的关键任务。传统生成方法仅关注文本质量,忽视教育目标,且多局限于单一维度的简单题目,难以满足复杂多维的教育需求。为此,我们构建并标注了包含1.6万道数学题的EduMath数据集,涵盖多维度教育目标。基于此,我们提出了EQGEVAL评估框架,包含三个评估维度,用于衡量模型生成教育类问题的能力。受教师出题过程启发,我们提出教育数学题规划与自我反思(EQPR)方法,采用“规划-评估-优化”循环流程。通过将蒙特卡洛树搜索的规划能力与大语言模型的生成能力结合,实现基于迭代反馈的自我优化。该机制确保生成题目既契合教育语境,又能精准达成特定基础教育目标。基于EQGEVAL的大量实验表明,EQPR在生成符合多维度教育目标的题目方面表现显著优于基线方法。
原文摘要 · Abstract (English)
Automatically generating high-quality mathematical problems that align with educational objectives is a crucial task in NLP-based educational technology. Traditional generation methods focus primarily on textual quality, but they often overlook educational objectives. Moreover, these methods address only single-dimensional, simple question generation, failing to meet complex, multifaceted educational requirements. To address these challenges, we constructed and annotated EduMath, a dataset of 16k mathematical questions with multi-dimensional educational objectives. Based on this dataset, we developed EQGEVAL, which incorporates three evaluation dimensions and is designed to assess the ability of models to generate educational questions. Drawing inspiration from teachers' problem design processes, we propose the Educational Question Planning with self-Reflection (EQPR) method for educational mathematical question generation, following a "plan-evaluate-optimize" approach. Specifically, by combining planning algorithm based on Monte Carlo Tree Search with the generative capabilities of Large Language Models, we continuously optimize questions through iterative feedback. This self-optimization mechanism ensures that the generated questions both fit the educational context and strategically achieve specific basic educational objectives. Through extensive experiments based on EQGEVAL, we have demonstrated that EQPR achieves significant improvements in generating questions that meet multi-dimensional educational objectives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。