arXiv:2504.20070cs.LG2025-04

用门控网络和自适应优化提升学生知识追踪模型效果

Improving Deep Knowledge Tracing via Gated Architectures and Adaptive Optimization

  • 改用LSTM/GRU替代标准RNN,更好捕捉长期学习依赖
  • 在Khan Academy等数据集上准确率提升,训练更稳定
  • 开源PyTorch实现,适合教育AI研究者复现与扩展

深度知识追踪(DKT)通过循环神经网络(RNN)基于历史交互数据预测学生未来表现。原版基于Lua的Torch框架限制了可扩展性与可复现性。本文从架构与优化两方面改进:引入长短期记忆(LSTM)和门控循环单元(GRU),有效缓解梯度消失问题并增强对长期依赖的建模能力;使用PyTorch重写代码,构建模块化、兼容现代深度学习流程的基础设施。在Synthetic-5与Khan Academy数据集上的实验表明,相较于基础RNN,GRU与LSTM显著提升准确率与训练稳定性;自适应优化器(如Adam、AdamW)在收敛速度与最终性能上均优于SGD。开源实现为神经知识追踪及个性化学习系统研究提供可复现、可扩展的基础。

原文摘要 · Abstract (English)

Deep Knowledge Tracing (DKT) models student learning behavior by using Recurrent Neural Networks (RNNs) to predict future performance based on historical interaction data. However, the original implementation relied on standard RNNs in the Lua-based Torch framework, which limited extensibility and reproducibility. In this work, we revisit the DKT model from two perspectives: architectural improvements and optimization efficiency. First, we enhance the model using gated recurrent units, specifically Long Short-Term Memory (LSTM) networks and Gated Recurrent Units (GRU), which better capture long-term dependencies and help mitigate vanishing gradient issues. Second, we re-implement DKT using the PyTorch framework, enabling a modular and accessible infrastructure compatible with modern deep learning workflows. We also benchmark several optimization algorithms SGD, RMSProp, Adagrad, Adam, and AdamW to evaluate their impact on convergence speed and predictive accuracy in educational modeling tasks. Experiments on the Synthetic-5 and Khan Academy datasets show that GRUs and LSTMs achieve higher accuracy and improved training stability compared to basic RNNs, while adaptive optimizers such as Adam and AdamW consistently outperform SGD in both early-stage learning and final model performance. Our open-source PyTorch implementation provides a reproducible and extensible foundation for future research in neural knowledge tracing and personalized learning systems.

知识追踪门控网络自适应优化教育AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。