让大模型像老师一样纠错,提升数学解题过程的准确性
SMRC: Aligning Large Language Models with Student Reasoning for Mathematical Error Correction
- 用MCTS搜索最优纠错路径,把学生解题过程当多步决策问题处理
- 通过双评估协议,解决率和正确步骤保留率均显著优于现有方法
- 构建中学数学纠错基准数据集,支持细粒度教育场景验证
大语言模型在解数学题时常出现推理错误,如何自动检测并纠正这些错误成为重要研究方向。现有方法主要聚焦于模型内部自修正,难以满足教育场景所需的系统性指导需求。为此,我们提出SMRC(学生数学推理纠错)方法,将学生推理过程建模为多步序列决策问题,并引入蒙特卡洛树搜索(MCTS)探索最优纠错路径。为降低标注成本,我们利用大模型引导的广度优先搜索(BFS)与最终答案评估生成奖励信号,并通过反向传播机制分配至中间推理步骤,实现细粒度过程监督。此外,我们构建了高中数学纠错基准MSEB,包含158个实例,涵盖题目、学生解答及正确推理路径。我们提出以解决方案准确率与正确步骤保留率为双核心的评估协议,全面衡量教育适用性。实验表明,SMRC在ProcessBench、MR-GSM8K及MSEB三个数据集上均显著优于现有方法。
原文摘要 · Abstract (English)
Large language models (LLMs) often make reasoning errors when solving mathematical problems, and how to automatically detect and correct these errors has become an important research direction. However, existing approaches \textit{mainly focus on self-correction within the model}, which falls short of the "teacher-style" correction required in educational settings, \textit{i.e.}, systematically guiding and revising a student' s problem-solving process. To address this gap, we propose \texttt{SMRC} (\textit{\underline{S}tudent \underline{M}athematical \underline{R}easoning \underline{C}orrection}), a novel method that aligns LLMs with student reasoning. Specifically, \texttt{SMRC} formulates student reasoning as a multi-step sequential decision problem and introduces Monte Carlo Tree Search (MCTS) to explore optimal correction paths. To reduce the cost of the annotating process-level rewards, we leverage breadth-first search (BFS) guided by LLMs and final-answer evaluation to generate reward signals, which are then distributed across intermediate reasoning steps via a back-propagation mechanism, enabling fine-grained process supervision. Additionally, we construct a benchmark for high school mathematics, MSEB (Multi-Solution Error Benchmark), consisting of 158 instances that include problem statements, student solutions, and correct reasoning steps. We further propose a dual evaluation protocol centered on \textbf{solution accuracy} and \textbf{correct-step retention}, offering a comprehensive measure of educational applicability. Experiments demonstrate that \texttt{SMRC} significantly outperforms existing methods on two public datasets (ProcessBench and MR-GSM8K) and our MSEB in terms of effectiveness and overall performance. The code are available at https://github.com/ECNU-RAIL/SMRC-EMNLP2026.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。