arXiv:2502.02945cs.CLcs.AI2025-02被引 15

用指令对齐大模型与知识追踪,提升学生答题预测准确率。

LLM-KT: Aligning Large Language Models with Knowledge Tracing using a Plug-and-Play Instruction

  • 通过可插拔指令让大模型理解知识追踪任务,融合世界知识推理。
  • 在四个数据集上超越近20个基线模型,达到当前最优性能。
  • 适合教育AI、个性化学习系统研究者参考使用。

知识追踪(KT)是个性化教育中的关键问题,旨在根据学生的历史答题记录预测其能否正确回答下一题。以往方法主要依赖题目ID或文本信息建模行为序列,但难以捕捉学生行为模式,缺乏对题目背后知识的深入理解。本文提出基于大语言模型(LLM)的KT框架——LLM-KT,通过可插拔指令实现任务层面的对齐,利用大模型丰富的知识储备和推理能力。在模态层面,设计可插入的上下文与序列模块,分别将传统方法提取的压缩上下文嵌入和序列交互表示融入大模型。为处理历史记录的长序列,引入基于题目标签和知识点标签的可插拔上下文机制;并通过序列适配器保留传统模型学到的行为序列特征。大量实验表明,LLM-KT在四个典型数据集上优于约20个强基线模型,达到当前最佳水平。

原文摘要 · Abstract (English)

The knowledge tracing (KT) problem is an extremely important topic in personalized education, which aims to predict whether students can correctly answer the next question based on their past question-answer records. Prior work on this task mainly focused on learning the sequence of behaviors based on the IDs or textual information. However, these studies usually fail to capture students' sufficient behavioral patterns without reasoning with rich world knowledge about questions. In this paper, we propose a large language models (LLMs)-based framework for KT, named \texttt{\textbf{LLM-KT}}, to integrate the strengths of LLMs and traditional sequence interaction models. For task-level alignment, we design Plug-and-Play instruction to align LLMs with KT, leveraging LLMs' rich knowledge and powerful reasoning capacity. For modality-level alignment, we design the plug-in context and sequence to integrate multiple modalities learned by traditional methods. To capture the long context of history records, we present a plug-in context to flexibly insert the compressed context embedding into LLMs using question-specific and concept-specific tokens. Furthermore, we introduce a plug-in sequence to enhance LLMs with sequence interaction behavior representation learned by traditional sequence models using a sequence adapter. Extensive experiments show that \texttt{\textbf{LLM-KT}} obtains state-of-the-art performance on four typical datasets by comparing it with approximately 20 strong baselines.

知识追踪大语言模型个性化教育可插拔

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。