arXiv:2501.09893cs.LG2025-01被引 1

用可学习的二值向量自动补充知识概念,提升学生答题预测效果。

Sparse Binary Representation Learning for Knowledge Tracing

  • 通过二值向量自动生成辅助知识点标签,替代人工定义。
  • 在多个数据集上优于基线模型,且提升经典BKT模型表现。
  • 适合作为知识追踪新思路,尤其适合缺乏完整标注的场景。

知识追踪(KT)模型旨在根据学生的历史答题行为预测其未来表现。现有模型依赖人工定义的知识点(KCs),其效果受标注质量与覆盖范围限制,且标注成本高。本文提出稀疏二值表示知识追踪模型(SBRKT),通过学习二值向量自动生成辅助知识点标签,以补充预设知识点。每个比特位代表一个辅助知识点的存在与否,生成离散表示,可兼容经典模型如贝叶斯知识追踪(BKT)及现代深度学习方法。该方法采用可训练的二值化策略,实现稀疏表示,并结合循环神经网络(RNN)捕捉时间动态,融合辅助与预设知识点进行预测。实验表明,SBRKT在多个数据集上超越基线,在其他数据集上表现相当;引入辅助知识点后,所有测试数据集上的BKT性能均得到一致提升。

原文摘要 · Abstract (English)

Knowledge tracing (KT) models aim to predict students' future performance based on their historical interactions. Most existing KT models rely exclusively on human-defined knowledge concepts (KCs) associated with exercises. As a result, the effectiveness of these models is highly dependent on the quality and completeness of the predefined KCs. Human errors in labeling and the cost of covering all potential underlying KCs can limit model performance. In this paper, we propose a KT model, Sparse Binary Representation KT (SBRKT), that generates new KC labels, referred to as auxiliary KCs, which can augment the predefined KCs to address the limitations of relying solely on human-defined KCs. These are learned through a binary vector representation, where each bit indicates the presence (one) or absence (zero) of an auxiliary KC. The resulting discrete representation allows these auxiliary KCs to be utilized in training any KT model that incorporates KCs. Unlike pre-trained dense embeddings, which are limited to models designed to accept such vectors, our discrete representations are compatible with both classical models, such as Bayesian Knowledge Tracing (BKT), and modern deep learning approaches. To generate this discrete representation, SBRKT employs a binarization method that learns a sparse representation, fully trainable via stochastic gradient descent. Additionally, SBRKT incorporates a recurrent neural network (RNN) to capture temporal dynamics and predict future student responses by effectively combining the auxiliary and predefined KCs. Experimental results demonstrate that SBRKT outperforms the tested baselines on several datasets and achieves competitive performance on others. Furthermore, incorporating the learned auxiliary KCs consistently enhances the performance of BKT across all tested datasets.

知识追踪二值表示自动标注BKT改进

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。