用微调语言模型增强学习者-题目嵌入,提升智能教育认知诊断效果
Embedding Enhancement via Fine-Tuned Language Models for Learner-Item Cognitive Modeling

- 通过角色特异性表示和交互诊断器微调语言模型,缩小语义差距
- 在4个认知诊断任务和计算机自适应测试中均表现稳健
- 框架统一适配多种任务,适合在线教育系统开发者参考
学习者-题目认知建模在基于网络的智能教育系统中至关重要,支持多样在线教育场景下的认知诊断(CD)。尽管项目嵌入(ID embedding)仍是主流方法,因其高效灵活,但语言模型(LMs)的进展为融入丰富语义表征以提升诊断性能提供了新可能。这凸显了对现有工作中语言模型如何通过语义融合增强嵌入进行全面分析的必要性。本文识别出两个关键挑战:语言模型训练目标与认知诊断模型之间存在特征空间分布差异;需建立统一框架,在保持现有建模范式优势的同时,整合不同任务的文本嵌入以确保增强的鲁棒性。为此,本文提出EduEmbed——一个统一的嵌入增强框架,利用微调的语言模型在多样化认知诊断任务中丰富学习者-题目建模。EduEmbed分两阶段运行:第一阶段基于角色特异性表示和交互诊断器微调语言模型,弥合认知诊断模型的语义鸿沟;第二阶段采用文本适配器提取任务相关语义,并与现有建模范式融合以提升泛化能力。我们在四个认知诊断任务和计算机自适应测试(CAT)任务上评估该框架,结果表现稳健。进一步分析揭示了语义信息在各类任务中的影响,为未来语言模型在在线智能教育系统认知诊断中的应用提供关键洞见。
原文摘要 · Abstract (English)
Learner-item cognitive modeling plays a central role in the web-based online intelligent education system by enabling cognitive diagnosis (CD) across diverse online educational scenarios. Although ID embedding remains the mainstream approach in cognitive modeling due to its effectiveness and flexibility, recent advances in language models (LMs) have introduced new possibilities for incorporating rich semantic representations to enhance CD performance. This highlights the need for a comprehensive analysis of how LMs enhance embeddings through semantic integration across mainstream CD tasks. This paper identifies two key challenges in fully leveraging LMs in existing work: Misalignment between the training objectives of LMs and CD models creates a distribution gap in feature spaces; A unified framework is essential for integrating textual embeddings across varied CD tasks while preserving the strengths of existing cognitive modeling paradigms to ensure the robustness of embedding enhancement. To address these challenges, this paper introduces EduEmbed, a unified embedding enhancement framework that leverages fine-tuned LMs to enrich learner-item cognitive modeling across diverse CD tasks. EduEmbed operates in two stages. In the first stage, we fine-tune LMs based on role-specific representations and an interaction diagnoser to bridge the semantic gap of CD models. In the second stage, we employ a textual adapter to extract task-relevant semantics and integrate them with existing modeling paradigms to improve generalization. We evaluate the proposed framework on four CD tasks and computerized adaptive testing (CAT) task, achieving robust performance. Further analysis reveals the impact of semantic information across diverse tasks, offering key insights for future research on the application of LMs in CD for online intelligent education systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。