arXiv:2508.17092cs.CYcs.AI2025-08被引 1

解决知识追踪中的标签泄露问题,提升预测准确率。

Enhancing Knowledge Tracing through Leakage-Free and Recency-Aware Embeddings

  • 用特殊标记替代真实答案,避免数据泄露
  • 引入时间距离编码,捕捉遗忘规律,效果优于传统位置编码
  • 适配多种模型,在多个基准上稳定提升性能

知识追踪(KT)旨在根据学生对学习内容的交互序列预测其未来表现。许多KT模型依赖知识点(KCs),代表每道题所需技能,但部分模型易受标签泄露影响——即输入数据无意中暴露正确答案,尤其在每题含多个知识点的数据集中。本文提出一种简单有效的解决方案:在可能产生标签泄露时,通过掩码机制替换真实标签,引入专用的\texttt{MASK}标签,借鉴BERT的掩码语言建模思想。同时,提出最近性编码(Recency Encoding),以编码当前题目与其最近一次出现之间的步数距离,该距离对建模遗忘等学习动态至关重要,而现有模型常忽略此因素。实验表明,该编码在多个KT基准上优于传统位置编码。将该嵌入方式应用于DKT、DKT+、AKT和SAKT等模型,均在多个基准上显著提升预测准确率,方法高效且通用。

原文摘要 · Abstract (English)

Knowledge Tracing (KT) aims to predict a student's future performance based on their sequence of interactions with learning content. Many KT models rely on knowledge concepts (KCs), which represent the skills required for each item. However, some of these models are vulnerable to label leakage, a phenomenon in which the input data inadvertently reveal the correct answer, particularly in datasets with multiple KCs per question. We propose a straightforward yet effective solution to prevent label leakage by masking ground-truth labels during input embedding construction whenever such leakage could occur. To accomplish this, we introduce a dedicated \texttt{MASK} label, inspired by masked language modeling (e.g., BERT), to replace ground-truth labels. In addition, we introduce Recency Encoding, which encodes the step-wise distance between the current item and its most recent previous occurrence. This distance is important for modeling learning dynamics such as forgetting, which is a fundamental aspect of human learning, yet it is often overlooked in existing models. Recency Encoding demonstrates improved performance over traditional positional encodings on multiple KT benchmarks. We show that incorporating our embeddings into KT models such as DKT, DKT+, AKT, and SAKT consistently improves prediction accuracy across multiple benchmarks. The approach is both efficient and widely applicable.

知识追踪标签泄露遗忘建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。