arXiv:2508.11184cs.CL2025-08ACL被引 3

根据学生错题历史生成个性化的错误选项,更精准发现认知漏洞。

Tailoring Diagnostic Modeling to Individual Learners: Personalized Distractor Generation via MCTS-Guided Reasoning Reconstruction

  • 用MCTS重构学生错题背后的思维过程,形成个体化误解模型。
  • 在6个学科1361名学生上验证,生成的错误选项更符合学生真实错误模式。
  • 无需训练,适合数据少的学生,也适用于群体教学场景。

错误选项(distractors)是多选题中干扰性正确答案,能有效暴露学生的理解偏差。现有方法生成通用错误选项,忽略个体差异,削弱诊断效果。本文提出个性化错误选项生成任务,基于学生过往答题记录推断其特定认知缺陷。由于每位学生数据有限且缺乏推理过程,传统训练方法难以适用。为此,我们提出无需训练的两阶段框架:第一阶段使用蒙特卡洛树搜索(MCTS)从历史错误中重建学生推理路径,构建个体化误解原型;第二阶段以此原型模拟学生对新题的错误推理,生成与其认知缺陷匹配的个性化错误选项。在涵盖6个学科、1361名学生的实验中,该方法显著优于现有方法,生成的错误选项更具合理性与个性化,同时具备良好的群体适应能力,展现强鲁棒性与通用性。

原文摘要 · Abstract (English)

Distractors-incorrect yet plausible answer choices in multiple-choice questions (MCQs)-are vital in educational assessments, as they help identify student misconceptions by presenting potential reasoning errors. Current distractor generation methods typically produce shared distractors for all students, ignoring the individual variations in reasoning, which limits their diagnostic effectiveness. To tackle this challenge, we introduce the task of Personalized Distractor Generation, which tailors distractors to each student's specific cognitive flaws, inferred from their past question-answering (QA) history. While promising, this task is particularly demanding due to the limited number of QA records available for each student, which are insufficient for training, as well as the absence of their underlying reasoning process. To overcome this, we propose a novel, training-free two-stage framework. In the first stage, Monte Carlo Tree Search (MCTS) is used to reconstruct the student's reasoning process from past errors, creating a student-specific misconception prototype. In the second stage, this prototype guides the simulation of the student's reasoning on new questions, generating personalized distractors that resonate with their individual misconceptions. Our experiments, conducted on 1,361 students across 6 subjects, demonstrate that this approach outperforms existing methods in generating plausible, personalized distractors, and also effectively adapts to group-level settings, highlighting its robustness and versatility.

教育评估个性化学习MCTS错误选项生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。