用大模型动态生成可解释的学生画像,提升学习追踪准确率。
CIKT: A Collaborative and Iterative Knowledge Tracing Framework with Large Language Models
- 双组件协同迭代:分析器生成学生画像,预测器据此预测表现
- 在多个数据集上准确率显著提升,用户画像持续优化
- 适合需要可解释性与高精度的教育AI系统开发者
知识追踪(KT)旨在建模学生随时间变化的学习状态并预测其未来表现。传统方法常面临可解释性差、扩展性不足及复杂知识依赖建模困难的问题。尽管大语言模型(LLMs)为KT带来新可能,但直接应用往往难以生成结构化、可解释的学生表征,且缺乏任务特定的持续优化机制。为此,我们提出协同迭代知识追踪(CIKT),利用LLMs同时提升预测准确率与可解释性。CIKT采用双组件架构:分析器从学生历史答题中生成动态可解释的用户画像,预测器则基于这些画像预测未来表现。核心是协同优化循环:分析器根据预测器的准确性反馈迭代优化,预测器再以改进后的画像重新训练。在多个教育数据集上的评估显示,CIKT显著提升预测准确率,通过动态更新的用户画像增强可解释性,并展现更好扩展性。本工作为推进知识追踪系统提供了鲁棒且可解释的解决方案,有效弥合了预测性能与模型透明度之间的差距。
原文摘要 · Abstract (English)
Knowledge Tracing (KT) aims to model a student's learning state over time and predict their future performance. However, traditional KT methods often face challenges in explainability, scalability, and effective modeling of complex knowledge dependencies. While Large Language Models (LLMs) present new avenues for KT, their direct application often struggles with generating structured, explainable student representations and lacks mechanisms for continuous, task-specific refinement. To address these gaps, we propose Collaborative Iterative Knowledge Tracing (CIKT), a framework that harnesses LLMs to enhance both prediction accuracy and explainability. CIKT employs a dual-component architecture: an Analyst generates dynamic, explainable user profiles from student historical responses, and a Predictor utilizes these profiles to forecast future performance. The core of CIKT is a synergistic optimization loop. In this loop, the Analyst is iteratively refined based on the predictive accuracy of the Predictor, which conditions on the generated profiles, and the Predictor is subsequently retrained using these enhanced profiles. Evaluated on multiple educational datasets, CIKT demonstrates significant improvements in prediction accuracy, offers enhanced explainability through its dynamically updated user profiles, and exhibits improved scalability. Our work presents a robust and explainable solution for advancing knowledge tracing systems, effectively bridging the gap between predictive performance and model transparency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。