用生成模型实现无需重训的快速学习诊断,速度提升百倍。
Generative Cognitive Diagnosis
- 将诊断从预测转为生成,解耦认知状态与答题行为。
- 新学习者诊断速度提升100倍,准确率显著优于传统方法。
- 适合智能教育系统、AI评估等需要快速推理的场景。
认知诊断(CD)通过分析学习者在诊断测试中的作答模式来推断其潜在认知状态,是教育评估的重要机器学习技术。传统方法采用归纳式预测范式,需重新优化参数以适配新学习者,计算成本高且诊断结果可靠性有限。本文提出一种新型生成式诊断范式,将CD从预测转向生成建模,实现无需参数重优化的归纳推理。我们设计了两种简洁有效的实例:生成式项目反应理论(G-IRT)和生成式神经认知诊断模型(G-NCDM),在真实数据集上表现显著优于传统方法。该生成框架通过精心设计的生成过程,结合可辨识性与单调性条件,解耦认知状态推断与答题预测。大量实验表明,该方法有效解决可扩展性与可靠性挑战,对新学习者的诊断速度提升达×100。本框架为人工智能在智能评测与智能教育系统中的应用开辟新路径。代码已开源:https://github.com/CSLiJT/Generative-CD.git。
原文摘要 · Abstract (English)
Cognitive diagnosis (CD) models latent cognitive states of human learners by analyzing their response patterns on diagnostic tests, serving as a crucial machine learning technique for educational assessment and evaluation. Traditional cognitive diagnosis models typically follow a transductive prediction paradigm that optimizes parameters to fit response scores and extract learner abilities. These approaches face significant limitations as they cannot perform instant diagnosis for new learners without computationally expensive retraining and produce diagnostic outputs with limited reliability. In this study, we introduces a novel generative diagnosis paradigm that fundamentally shifts CD from predictive to generative modeling, enabling inductive inference of cognitive states without parameter re-optimization. We propose two simple yet effective instantiations of this paradigm: Generative Item Response Theory (G-IRT) and Generative Neural Cognitive Diagnosis Model (G-NCDM), which achieve excellent performance improvements over traditional methods. The generative approach disentangles cognitive state inference from response prediction through a well-designed generation process that incorporates identifiability and monotonicity conditions. Extensive experiments on real-world datasets demonstrate the effectiveness of our methodology in addressing scalability and reliability challenges, especially $\times 100$ speedup for the diagnosis of new learners. Our framework opens new avenues for cognitive diagnosis applications in artificial intelligence, particularly for intelligent model evaluation and intelligent education systems. The code is available at https://github.com/CSLiJT/Generative-CD.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。