arXiv:2502.05556cs.AI2025-02AAAI被引 28

用大模型提升学习诊断,解决冷门学生和题目识别难问题

Knowledge is Power: Harnessing Large Language Models for Enhanced Cognitive Diagnosis

  • 用大模型对师生和题目做深度语义诊断
  • 通过对比学习和掩码重建提升行为与语义空间匹配度
  • 兼容多种诊断模型,适合教育智能系统开发者

认知诊断模型(CDMs)通过分析学生在一系列练习中的表现来评估其认知状态。然而,现有CDMs在诊断低频学生和练习时表现不佳,主要因缺乏丰富先验知识。随着大语言模型(LLMs)在领域知识上的积累,将其融入认知诊断成为可能。但存在挑战:LLMs难以捕捉学生与练习间的细粒度协同关系,且其语义空间与CDMs的行为空间存在差异。为此,我们提出一种新型知识增强型认知诊断(KCD)框架,该框架不依赖特定模型结构,可适配多种CDM架构。KCD分为两个阶段:第一阶段为LLM诊断,对师生及练习进行全方位建模;第二阶段为认知层级对齐,采用对比学习与掩码重建方法弥合行为空间与语义空间的差距。在多个真实数据集上的实验表明,所提框架有效提升了诊断性能。

原文摘要 · Abstract (English)

Cognitive Diagnosis Models (CDMs) are designed to assess students' cognitive states by analyzing their performance across a series of exercises. However, existing CDMs often struggle with diagnosing infrequent students and exercises due to a lack of rich prior knowledge. With the advancement in large language models (LLMs), which possess extensive domain knowledge, their integration into cognitive diagnosis presents a promising opportunity. Despite this potential, integrating LLMs with CDMs poses significant challenges. LLMs are not well-suited for capturing the fine-grained collaborative interactions between students and exercises, and the disparity between the semantic space of LLMs and the behavioral space of CDMs hinders effective integration. To address these issues, we propose a novel Knowledge-enhanced Cognitive Diagnosis (KCD) framework, which is a model-agnostic framework utilizing LLMs to enhance CDMs and compatible with various CDM architectures. The KCD framework operates in two stages: LLM Diagnosis and Cognitive Level Alignment. In the LLM Diagnosis stage, both students and exercises are diagnosed to achieve comprehensive and detailed modeling. In the Cognitive Level Alignment stage, we bridge the gap between the CDMs' behavioral space and the LLMs' semantic space using contrastive learning and mask-reconstruction approaches. Experiments on several real-world datasets demonstrate the effectiveness of our proposed framework.

认知诊断大模型教育AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。