arXiv:2504.00615cs.AI2025-04被引 5

对比三类AI在教育数据中的可解释性与泛化能力,发现混合模型更可信。

Towards Responsible and Trustworthy Educational Data Mining: Comparing Symbolic, Sub-Symbolic, and Neural-Symbolic AI Methods

  • 用符号、子符号与神经符号方法分析学生学习数据
  • 混合模型在数据不平衡时仍能识别低表现者,准确率更高
  • 适合关注教育AI可信度的研究者与实践者

针对教育领域对负责任、可信AI的需求,本研究评估了符号、子符号与神经符号人工智能(NSAI)在泛化性和可解释性方面的表现。在爱沙尼亚小学生自控学习数据集上,预测七年级数学全国测试成绩的实验显示:符号与子符号方法在平衡数据中表现良好,但在数据不平衡时难以识别低表现者。符号方法主要依赖认知与动机因素,子符号方法更关注认知与已学知识,且受性别影响,但二者均忽视元认知因素。相比之下,神经符号方法具有优势:(1)在两类数据中均具更强泛化能力,其符号知识弥补了少数类样本不足;(2)决策过程整合了动机、(元)认知与学业知识,提供理论支持下的全面可解释框架。结果表明,仅凭预测性能无法全面评价AI方法,混合型、以人为本的神经符号方法更能应对局限,推动教育数据挖掘向负责任方向发展。通过让利益相关者参与设计,该方法使学习模式与理论一致,融入动机与元认知等关键因素,提升可信度与责任感。

原文摘要 · Abstract (English)

Given the demand for responsible and trustworthy AI for education, this study evaluates symbolic, sub-symbolic, and neural-symbolic AI (NSAI) in terms of generalizability and interpretability. Our extensive experiments on balanced and imbalanced self-regulated learning datasets of Estonian primary school students predicting 7th-grade mathematics national test performance showed that symbolic and sub-symbolic methods performed well on balanced data but struggled to identify low performers in imbalanced datasets. Interestingly, symbolic and sub-symbolic methods emphasized different factors in their decision-making: symbolic approaches primarily relied on cognitive and motivational factors, while sub-symbolic methods focused more on cognitive aspects, learnt knowledge, and the demographic variable of gender -- yet both largely overlooked metacognitive factors. The NSAI method, on the other hand, showed advantages by: (i) being more generalizable across both classes -- even in imbalanced datasets -- as its symbolic knowledge component compensated for the underrepresented class; and (ii) relying on a more integrated set of factors in its decision-making, including motivation, (meta)cognition, and learnt knowledge, thus offering a comprehensive and theoretically grounded interpretability framework. These contrasting findings highlight the need for a holistic comparison of AI methods before drawing conclusions based solely on predictive performance. They also underscore the potential of hybrid, human-centred NSAI methods to address the limitations of other AI families and move us closer to responsible AI for education. Specifically, by enabling stakeholders to contribute to AI design, NSAI aligns learned patterns with theoretical constructs, incorporates factors like motivation and metacognition, and strengthens the trustworthiness and responsibility of educational data mining.

教育AI可解释性神经符号责任算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。