arXiv:2502.19915cs.AI2025-02被引 5

用大模型提升知识追踪精度,解决冷启动与可解释性难题

LLM-driven Effective Knowledge Tracing by Integrating Dual-channel Difficulty

  • 引入双通道难度感知,融合主观与客观难度评估
  • 在真实数据集上AUC提升2%~10%,显著改善冷启动问题
  • 适合教育AI研究者及智能辅导系统开发者使用

知识追踪(KT)是智能辅导系统中的核心技术,用于模拟学习过程中学生知识状态的变化,跟踪个性化掌握程度并预测表现。然而当前KT模型面临三大挑战:(1) 遇到新题时因交互记录稀疏导致冷启动问题,难以精准建模;(2) 传统模型仅依赖历史交互进行个性化建模,无法准确追踪个体掌握水平,个性化建模模糊;(3) 决策过程对教育者不透明,难以理解模型判断依据。为此,我们提出一种新型双通道难度感知知识追踪(DDKT)框架,利用大语言模型(LLM)和检索增强生成(RAG)进行主观难度评估,并结合难度偏差感知算法与学生掌握度算法实现精确难度测量。框架包含三项关键创新:(1) 难度平衡感知序列(DBPS)——通过注意力机制衡量大模型评估难度、统计难度与学生主观感知难度之间的差距;(2) 难度掌握比率(DMR)——在不同难度区间精准建模学生掌握水平;(3) 知识状态更新机制——通过门控网络实现个性化知识获取并更新学生知识状态。在两个真实数据集上的实验表明,该方法持续优于九种基线模型,AUC指标提升2%至10%,有效缓解冷启动问题并增强模型可解释性。

原文摘要 · Abstract (English)

Knowledge Tracing (KT) is a fundamental technology in intelligent tutoring systems used to simulate changes in students' knowledge state during learning, track personalized knowledge mastery, and predict performance. However, current KT models face three major challenges: (1) When encountering new questions, models face cold-start problems due to sparse interaction records, making precise modeling difficult; (2) Traditional models only use historical interaction records for student personalization modeling, unable to accurately track individual mastery levels, resulting in unclear personalized modeling; (3) The decision-making process is opaque to educators, making it challenging for them to understand model judgments. To address these challenges, we propose a novel Dual-channel Difficulty-aware Knowledge Tracing (DDKT) framework that utilizes Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) for subjective difficulty assessment, while integrating difficulty bias-aware algorithms and student mastery algorithms for precise difficulty measurement. Our framework introduces three key innovations: (1) Difficulty Balance Perception Sequence (DBPS) - students' subjective perceptions combined with objective difficulty, measuring gaps between LLM-assessed difficulty, mathematical-statistical difficulty, and students' subjective perceived difficulty through attention mechanisms; (2) Difficulty Mastery Ratio (DMR) - precise modeling of student mastery levels through different difficulty zones; (3) Knowledge State Update Mechanism - implementing personalized knowledge acquisition through gated networks and updating student knowledge state. Experimental results on two real datasets show our method consistently outperforms nine baseline models, improving AUC metrics by 2% to 10% while effectively addressing cold-start problems and enhancing model interpretability.

知识追踪大模型教育AI可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。