让AI tutoring系统读懂学生难易程度,预测更准还看得懂。
Interpretable Difficulty-Aware Knowledge Tracing in Tutor-Student Dialogues

- 显式建模学生能力与题目难度,结合认知理论提升可解释性。
- 在两个对话数据集上表现优于现有基线,预测准确率更高。
- 适合需要透明化学习评估的智能教育场景使用。
大语言模型(LLMs)的发展推动了基于对话的AI辅导系统兴起。为实现个性化支持,需在每轮对话中评估学生表现,从而推动对话场景下的知识追踪(KT)。然而,现有方法常忽略题目难度建模,且依赖黑箱式的隐向量表示,难以实现准确、可解释的预测。本文提出一种基于LLM的可解释难度感知对话式知识追踪框架,显式建模每轮对话中学生的知识水平与任务难度。该框架融合原始题干和下一阶段教师提问内容,结合项目反应理论(Item Response Theory),将LLM输出映射为学生能力与题目难度参数,实现基于认知学习理论的可解释性能预测。在两个师生对话数据集上的实验表明,本框架在定量与定性结果上均优于现有基线,且输出结果符合认知理论预期。
原文摘要 · Abstract (English)
Recent advances in large language models (LLMs) have led to the development of AI-powered tutoring systems that provide interactive support via dialogue. To enable these tutoring systems to provide personalized support, it is essential to assess student performance at each turn, motivating knowledge tracing (KT) in dialogue settings. However, existing dialogue-based KT approaches often ignore question difficulty modeling and rely on opaque latent representations from LLMs, hindering accurate and interpretable prediction. In this work, we propose an interpretable difficulty-aware conversational KT framework built upon LLMs, which explicitly models students' abilities and the difficulty of tutor-posed tasks at each turn. The framework incorporates the original textual question and the next tutor-posed task to estimate the student's knowledge state and the difficulty of the upcoming turn. Furthermore, it integrates Item Response Theory to map LLM's outputs into student ability and question difficulty parameters, enabling interpretable prediction of student performance grounded in cognitive theories of learning. We evaluate the framework on two tutor-student dialogue datasets. Both quantitative and qualitative results show that our framework outperforms existing KT baselines, meanwhile generating interpretable outputs consistent with cognitive theory.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。