用扩散模型迁移学习,让测验系统冷启动时更准更快。
Diffusion-Inspired Cold Start with Sufficient Prior in Computerized Adaptive Testing
- 基于扩散模型构建认知状态跨领域迁移桥梁
- 在5个真实数据集上显著提升冷启动测试准确率
- 适合在线教育平台优化新用户评估体验
计算机化自适应测试(CAT)旨在根据考生能力选择最合适的题目,广泛应用于在线教育。然而现有系统缺乏对考生能力的初始认知,需通过随机试探题来启动,导致题目匹配不佳、测试时间延长且影响考生心态,此即‘先验不足的冷启动’(CSIP)问题。该问题源于未有效利用在线平台上其他课程中的考生答题记录——这些记录因不同知识领域间认知状态的共性,可为当前目标领域提供宝贵先验信息。然而此前尚无研究针对此任务。为此,本文提出基于扩散模型的扩散认知状态迁移框架(DCSR),构建跨领域的认知状态转移路径,利用考生在不同领域的共性认知特征,引导模型重建目标域的初始能力状态。为增强生成数据表达力,从因果视角分析生成过程,避免冗余认知状态导致的迁移受限或负迁移。所生成的初始能力状态可无缝集成至现有题目选择算法中,显著改善冷启动表现。在五个真实数据集上的大量实验表明,DCSR在解决CSIP任务上显著优于现有基线方法。
原文摘要 · Abstract (English)
Computerized Adaptive Testing (CAT) aims to select the most appropriate questions based on the examinee's ability and is widely used in online education. However, existing CAT systems often lack initial understanding of the examinee's ability, requiring random probing questions. This can lead to poorly matched questions, extending the test duration and negatively impacting the examinee's mindset, a phenomenon referred to as the Cold Start with Insufficient Prior (CSIP) task. This issue occurs because CAT systems do not effectively utilize the abundant prior information about the examinee available from other courses on online platforms. These response records, due to the commonality of cognitive states across different knowledge domains, can provide valuable prior information for the target domain. However, no prior work has explored solutions for the CSIP task. In response to this gap, we propose Diffusion Cognitive States TransfeR Framework (DCSR), a novel domain transfer framework based on Diffusion Models (DMs) to address the CSIP task. Specifically, we construct a cognitive state transition bridge between domains, guided by the common cognitive states of examinees, encouraging the model to reconstruct the initial ability state in the target domain. To enrich the expressive power of the generated data, we analyze the causal relationships in the generation process from a causal perspective. Redundant and extraneous cognitive states can lead to limited transfer and negative transfer effects. Our DCSR can seamlessly apply the generated initial ability states in the target domain to existing question selection algorithms, thus improving the cold start performance of the CAT system. Extensive experiments conducted on five real-world datasets demonstrate that DCSR significantly outperforms existing baseline methods in addressing the CSIP task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。