用大模型语义知识提升认知诊断,支持新学生新题目冷启动
LLM4CD: Leveraging Large Language Models for Open-World Knowledge Augmented Cognitive Diagnosis
- 用大模型生成语义文本表示,替代传统编号嵌入
- 在多个真实数据集上超越现有方法,显著提升诊断准确率
- 适合需要动态扩展学生与题目的智能教育系统
认知诊断(CD)在智能教育中至关重要,基于学生测试历史评估其对知识点的掌握程度。然而,现有方法仅依赖学生、题目和知识点的编号关系,忽略了教育数据中丰富的语义信息。同时,当前智能辅导系统常引入新学生和新题目,基于编号的方法难以应对。大语言模型(LLMs)具备开放世界知识,可缓解此问题。本文提出 LLM4CD,利用大模型构建具认知表达力的文本表示,并通过双层编码器框架建模学生测试历史:宏观层面的认知文本编码器与微观层面的知识状态编码器。该方法以语义表示替代传统编号嵌入,使模型能借助开放世界知识处理新用户和新题目,解决冷启动问题。大量实验表明,该方法在多个真实数据集上持续优于现有CD模型,验证了引入大模型语义信息的有效性。
原文摘要 · Abstract (English)
Cognitive diagnosis (CD) plays a crucial role in intelligent education, evaluating students' comprehension of knowledge concepts based on their test histories. However, current CD methods often model students, exercises, and knowledge concepts solely on their ID relationships, neglecting the abundant semantic relationships present within educational data space. Furthermore, contemporary intelligent tutoring systems (ITS) frequently involve the addition of new students and exercises, a situation that ID-based methods find challenging to manage effectively. The advent of large language models (LLMs) offers the potential for overcoming this challenge with open-world knowledge. In this paper, we propose LLM4CD, which Leverages Large Language Models for Open-World Knowledge Augmented Cognitive Diagnosis. Our method utilizes the open-world knowledge of LLMs to construct cognitively expressive textual representations, which are then encoded to introduce rich semantic information into the CD task. Additionally, we propose an innovative bi-level encoder framework that models students' test histories through two levels of encoders: a macro-level cognitive text encoder and a micro-level knowledge state encoder. This approach substitutes traditional ID embeddings with semantic representations, enabling the model to accommodate new students and exercises with open-world knowledge and address the cold-start problem. Extensive experimental results demonstrate that our proposed method consistently outperforms previous CD models on multiple real-world datasets, validating the effectiveness of leveraging LLMs to introduce rich semantic information into the CD task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。