用专家路由机制捕捉学生多样化学习模式,提升知识追踪效果。
RouterKT: Mixture-of-Experts for Knowledge Tracing
- 引入个性化路由机制,让不同专家专注特定学习模式。
- 在10个数据集上平均AUC提升最高达3.29%。
- 无需预设遗忘机制,适合真实教育场景快速推理。
知识追踪(KT)是智能辅导系统中的核心任务,旨在基于学生交互历史建模其动态知识状态。现有方法多依赖全局遗忘衰减机制,假设学生表现主要受最近交互影响,难以捕捉个体差异和不同学习阶段的复杂模式。为此,我们提出RouterKT,一种新型的混合专家(MoE)架构,通过无须人工设定学习模式偏置(如遗忘衰减)的方式,使专家能自主专精于不同学习模式。RouterKT采用个性化路由机制建模个体特异性学习行为,并利用多头作为专家增强对复杂多样模式的表达能力。在10个基准数据集上的实验表明,RouterKT显著提升了多种KT骨干模型的性能,跨模型与数据集平均AUC最大提升3.29%,优于现有最先进模型。同时,其推理效率明显优于依赖手工设计学习模式偏置的方法,具备实际教育应用潜力。源代码已公开于https://github.com/ringotc/RouterKT.git。
原文摘要 · Abstract (English)
Knowledge Tracing (KT) is a fundamental task in Intelligent Tutoring Systems (ITS), which aims to model the dynamic knowledge states of students based on their interaction histories. However, existing KT models often rely on a global forgetting decay mechanism for capturing learning patterns, assuming that students' performance is predominantly influenced by their most recent interactions. Such approaches fail to account for the diverse and complex learning patterns arising from individual differences and varying learning stages. To address this limitation, we propose RouterKT, a novel Mixture-of-Experts (MoE) architecture designed to capture heterogeneous learning patterns by enabling experts to specialize in different patterns without any handcrafted learning pattern bias such as forgetting decay. Specifically, RouterKT introduces a \textbf{person-wise routing mechanism} to effectively model individual-specific learning behaviors and employs \textbf{multi-heads as experts} to enhance the modeling of complex and diverse patterns. Comprehensive experiments on ten benchmark datasets demonstrate that RouterKT exhibits significant flexibility and improves the performance of various KT backbone models, with a maximum average AUC improvement of 3.29\% across different backbones and datasets, outperforming other state-of-the-art models. Moreover, RouterKT demonstrates consistently superior inference efficiency compared to existing approaches based on handcrafted learning pattern bias, highlighting its usability for real-world educational applications. The source code is available at https://github.com/ringotc/RouterKT.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。