用大模型动态生成语义嵌入,实现多粒度协同知识追踪
MOSAIC: Orchestrating Collaborative Knowledge Tracing with Hierarchical Semantic Alignment

- 用冻结大模型生成上下文感知的语义嵌入和层级提示
- 在三个数据集上提升AUC最高3.4%,准确率最高2.5%
- 适合需要解释性与协作学习场景的个性化教育系统
知识追踪对个性化教育至关重要,但传统方法依赖浅层ID表示,忽略语义深度,且仅支持单一粒度掌握度估计,忽视知识层级依赖。为此,我们提出MOSAIC(多粒度在线语义智能协同知识追踪)框架,将大模型驱动的语义对齐与序列建模结合。不同于仅用大模型做预测的方法,MOSAIC利用冻结大模型生成动态、上下文感知的嵌入及层级预测提示,显式捕捉协作信号与同伴互动。此外,引入跨粒度一致性目标,在概念、主题簇和全局能力层面联合正则化掌握度估计。在ASSISTments、EdNet及新收集的大规模MOOC数据集上的实验表明,MOSAIC达到新最优性能:所有基准上AUC提升最高达3.4%,准确率提升最高达2.5%。尤其在协作密集环境与长序列场景中表现优异(MOOC上AUC达0.862),兼具高预测精度与语义可解释性。
原文摘要 · Abstract (English)
Knowledge Tracing (KT) is important for personalized education but traditionally suffers from two key limitations: a reliance on shallow ID-based representations that neglect semantic depth and a restriction to single-granularity mastery estimation that overlooks hierarchical knowledge dependencies. To address these challenges, we propose MOSAIC (Multi-granularity Online Semantic AI for Collaborative Knowledge), a novel framework that orchestrates LLM-driven semantic alignment with sequential modeling. Unlike methods that use LLMs solely as predictors, MOSAIC leverages a frozen LLM to generate dynamic, context-aware embeddings and hierarchical prediction prompts, explicitly capturing collaborative signals and peer interactions. Furthermore, we introduce a cross-granularity consistency objective that jointly regularizes mastery estimation across concept, topic-cluster, and global proficiency levels. Extensive experiments on ASSISTments, EdNet, and a newly collected large-scale MOOC dataset demonstrate that MOSAIC establishes new state-of-the-art results. Specifically, our method achieves AUC improvements of up to 3.4\% and Accuracy gains of up to 2.5 \% across all benchmarks. Notably, MOSAIC exhibits superior robustness in collaboration-rich environments and long-sequence scenarios (AUC 0.862 on MOOC), offering both high predictive precision and semantically grounded interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。