用对抗训练解决知识追踪中多步推理的误差累积问题
AdvKT: An Adversarial Multi-Step Training Framework for Knowledge Tracing
- 引入生成器与判别器,模拟多步高奖励响应以减少误差传播
- 在四个真实数据集上显著优于现有模型,有效缓解误差累积与数据稀疏
- 适合需要精准长期学习状态预测的智能辅导系统开发者
知识追踪(KT)用于监测学生知识状态并模拟其对题序的响应。现有KT模型通常采用单步训练范式,与真实场景中的多步推理过程存在差异,导致误差显著累积。这一误差累积结合数据稀疏性问题,会严重降低智能辅导系统中推荐模型的性能。为此,我们提出首个专注于多步知识追踪任务的对抗式多步训练框架AdvKT。AdvKT采用对抗学习机制,包含生成器和判别器:生成器模仿高奖励响应,有效减少多步过程中的误差积累;判别器提供反馈以生成合成数据。此外,设计专用数据增强技术,引入真实变化丰富训练数据,提升模型在稀疏数据下的泛化能力。在四个真实世界数据集上的实验表明,AdvKT显著优于现有KT模型,能有效应对误差累积与数据稀疏问题。
原文摘要 · Abstract (English)
Knowledge Tracing (KT) monitors students' knowledge states and simulates their responses to question sequences. Existing KT models typically follow a single-step training paradigm, which leads to discrepancies with the multi-step inference process required in real-world simulations, resulting in significant error accumulation. This accumulation of error, coupled with the issue of data sparsity, can substantially degrade the performance of recommendation models in the intelligent tutoring systems. To address these challenges, we propose a novel Adversarial Multi-Step Training Framework for Knowledge Tracing (AdvKT), which, for the first time, focuses on the multi-step KT task. More specifically, AdvKT leverages adversarial learning paradigm involving a generator and a discriminator. The generator mimics high-reward responses, effectively reducing error accumulation across multiple steps, while the discriminator provides feedback to generate synthetic data. Additionally, we design specialized data augmentation techniques to enrich the training data with realistic variations, ensuring that the model generalizes well even in scenarios with sparse data. Experiments conducted on four real-world datasets demonstrate the superiority of AdvKT over existing KT models, showcasing its ability to address both error accumulation and data sparsity issues effectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。