arXiv:2605.14752cs.LGcs.AI2026-05ACL被引 1

通过认知不确定性筛选关键样本,提升学生错因识别准确率。

Cognitive-Uncertainty Guided Knowledge Distillation for Accurate Classification of Student Misconceptions

论文配图:Cognitive-Uncertainty Guided Knowledge Distillation for Accurate Classification of Student Misconceptions
图 1 · 摘自论文原文
  • 基于认知不确定性的双层样本选择机制,挖掘高价值数据
  • 仅用10.3%过滤样本,实现MAP@3达0.9585,提升17.8%
  • 小模型(4B参数)在跨主题测试中达84.38%,优于大模型

准确识别学生错因对个性化教育至关重要,但面临三大挑战:(1) 数据稀缺且长尾分布,真实学生推理难以合成;(2) 错误类别边界模糊,标注噪声高;(3) 大模型因预训练偏见忽略非常规方法,无法部署于边缘设备,小模型则易受噪声过拟合。不同于传统通过大规模数据合成增加多样性的方式,本文提出两阶段知识蒸馏框架,从现有数据中挖掘高价值样本。第一阶段进行标准蒸馏以传递任务能力。第二阶段引入基于认知不确定性的双层边缘选择机制,根据教师模型不确定性与置信度差异识别四类关键样本。针对不同数据子集,设计难度自适应机制,平衡硬/软标签贡献,使学生模型既能继承教师软标签的类别间关系,又能区分模糊错误类型。实验表明,仅在10.30%筛选样本上增强训练,即在MAP-Charting数据集上达到MAP@3为0.9585(+17.8%);使用4B参数模型,在中学代数错因基准的跨主题测试中取得84.38%准确率,显著优于当前最优大模型(67.73%)和标准微调的72B模型(81.25%)。代码已开源。

原文摘要 · Abstract (English)

Accurately identifying student misconceptions is crucial for personalized education but faces three challenges: (1) data scarcity with long-tail distribution, where authentic student reasoning is difficult to synthesize; (2) fuzzy boundaries between error categories with high annotation noise; (3) deployment parado-large models overlook unconventional approaches due to pretraining bias and cannot be deployed on edge, while small models overfit to noise. Unlike traditional methods that increase diversity through large-scale data synthesis, we propose a two-stage knowledge distillation framework that mines high-value samples from existing data. The first stage performs standard distillation to transfer task capabilities. The second stage introduces a dual-layer marginal selection mechanism based on cognitive uncertainty, identifying four types of critical samples based on teacher model uncertainty and confidence differences. For different data subsets, we design difficulty-adaptive mechanism to balance hard/soft label contributions, enabling student models to inherit inter-class relationships from teacher soft labels while distinguishing ambiguous error types. Experiments show that with augmented training on only 10.30% of filtered samples, we achieve MAP@3 of 0.9585 (+17.8%) on the MAP-Charting dataset, and using only a 4B parameter model, we attain 84.38% accuracy on cross-topic tests of middle school algebra misconception benchmarks, significantly outperforming sota LLM (67.73%) and standard fine-tuned 72B models (81.25%). Our code is available at https://github.com/RoschildRui/acl2026_map.

知识蒸馏学生错因识别小模型优化认知不确定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。