arXiv:2601.06633cs.LGcs.AI2026-01ACL被引 6

用知识对齐方法模拟学生编程错误,提升错误预测多样性。

KASER: Knowledge-Aligned Student Error Simulator for Open-Ended Coding Tasks

  • 基于强化学习设计混合奖励,对齐错误与学生知识
  • 在两个真实数据集上,错误覆盖率和代码多样性均超越基线
  • 适合教育AI、自动评测系统开发者参考

开放性编程任务(如计算机科学教育中的常见题目)能提供学生知识的详细洞察。然而,训练大语言模型(LLMs)以模拟和预测学生在这些任务中的可能错误存在挑战:模型常出现模式崩溃,难以充分捕捉学生回答在语法、风格和解题方式上的多样性。本文提出KASER(Knowledge-Aligned Student Error Simulator),一种将错误与学生知识对齐的新方法。我们设计了一种基于强化学习的训练机制,采用混合奖励,综合考量三个维度:代码与真实答案的相似度、错误匹配度、代码预测多样性。在两个真实数据集上进行两级评估显示:在个体学生-题目对层面,我们的方法在代码和错误预测上优于基线;在题目层面,错误覆盖率和生成代码多样性均显著超越基线。

原文摘要 · Abstract (English)

Open-ended tasks, such as coding problems that are common in computer science education, provide detailed insights into student knowledge. However, training large language models (LLMs) to simulate and predict possible student errors in their responses to these problems can be challenging: they often suffer from mode collapse and fail to fully capture the diversity in syntax, style, and solution approach in student responses. In this work, we present KASER (Knowledge-Aligned Student Error Simulator), a novel approach that aligns errors with student knowledge. We propose a training method based on reinforcement learning using a hybrid reward that reflects three aspects of student code prediction: i) code similarity to the ground-truth, ii) error matching, and iii) code prediction diversity. On two real-world datasets, we perform two levels of evaluation and show that: At the per-student-problem pair level, our method outperforms baselines on code and error prediction; at the per-problem level, our method outperforms baselines on error coverage and simulated code diversity.

编程教育错误模拟强化学习大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。