提出新模型减轻学生认知偏差,让优生不躺平、差生不崩溃。
Disentangled Knowledge Tracing for Alleviating Cognitive Bias
- 分离学生熟悉/不熟能力,用因果分析消除数据偏见影响
- 在11个基准和3个合成数据集上显著降低认知偏差
- 适合做个性化教学系统的研发者或教育数据科学家
在智能辅导系统中,知识追踪(KT)需准确评估学生知识状态以实现个性化学习。但因数据偏倚(如题目概念分布不均),传统KT模型易产生认知偏差,导致优等生认知不足、差生负担过重,且该偏差会随系统推荐进一步放大。深入分析发现,根源在于学生历史正确率在题目组上的分布对学习表征与预测分数产生混杂效应。为此,本文提出解耦知识追踪(DisKT)模型,基于因果效应分别建模学生对熟悉与不熟悉内容的能力,并在模型中消除混杂因子的影响。为应对数据中的矛盾心理(如猜题、误答),引入矛盾注意力机制。同时,结合改进的项目反应理论提升预测可解释性。在11个基准数据集及3个不同偏倚强度的合成数据集上的实验表明,DisKT显著缓解认知偏差,优于16个基线模型,在评估准确性上表现优异。
原文摘要 · Abstract (English)
In the realm of Intelligent Tutoring System (ITS), the accurate assessment of students' knowledge states through Knowledge Tracing (KT) is crucial for personalized learning. However, due to data bias, $\textit{i.e.}$, the unbalanced distribution of question groups ($\textit{e.g.}$, concepts), conventional KT models are plagued by cognitive bias, which tends to result in cognitive underload for overperformers and cognitive overload for underperformers. More seriously, this bias is amplified with the exercise recommendations by ITS. After delving into the causal relations in the KT models, we identify the main cause as the confounder effect of students' historical correct rate distribution over question groups on the student representation and prediction score. Towards this end, we propose a Disentangled Knowledge Tracing (DisKT) model, which separately models students' familiar and unfamiliar abilities based on causal effects and eliminates the impact of the confounder in student representation within the model. Additionally, to shield the contradictory psychology ($\textit{e.g.}$, guessing and mistaking) in the students' biased data, DisKT introduces a contradiction attention mechanism. Furthermore, DisKT enhances the interpretability of the model predictions by integrating a variant of Item Response Theory. Experimental results on 11 benchmarks and 3 synthesized datasets with different bias strengths demonstrate that DisKT significantly alleviates cognitive bias and outperforms 16 baselines in evaluation accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。