arXiv:2409.00001cs.CVcs.AI2024-09被引 12

用可解释AI分析婴儿动作视频,提前识别脑瘫风险。

Evaluating Explainable AI Methods in Deep Learning Models for Early Detection of Cerebral Palsy

  • 用骨架数据和扰动测试评估CAM与Grad-CAM的可靠性。
  • Grad-CAM在运动速度稳定性上表现更优,CAM在骨骼稳定上更强。
  • 集成模型使解释更具鲁棒性,适合临床辅助决策。

早期发现脑瘫(CP)对有效干预至关重要。本文通过深度学习模型分析婴儿运动视频提取的骨架数据,预测脑瘫,并使用可解释人工智能(XAI)评估指标——忠实度与稳定性,量化评估类激活映射(CAM)和梯度加权类激活映射(Grad-CAM)在该医学应用中的可靠性。我们采用独特婴儿运动数据集,对骨架数据进行扰动但不改变原始动态。所用脑瘫预测模型为集成方法,因此分别评估了整体集成与各子模型的XAI性能。结果表明,两种方法均能有效识别影响预测的关键身体部位,且解释对微小数据扰动具有鲁棒性。在衡量速度稳定性的RISv指标中,Grad-CAM显著优于CAM;而在衡量骨骼稳定性的RISb指标及内部表示鲁棒性(RRS)指标中,CAM表现更佳。集成模型内各子模型表现各异,未出现统一优劣,集成方式整合了多个模型的结果,提供更全面的解释视图。

原文摘要 · Abstract (English)

Early detection of Cerebral Palsy (CP) is crucial for effective intervention and monitoring. This paper tests the reliability and applicability of Explainable AI (XAI) methods using a deep learning method that predicts CP by analyzing skeletal data extracted from video recordings of infant movements. Specifically, we use XAI evaluation metrics -- namely faithfulness and stability -- to quantitatively assess the reliability of Class Activation Mapping (CAM) and Gradient-weighted Class Activation Mapping (Grad-CAM) in this specific medical application. We utilize a unique dataset of infant movements and apply skeleton data perturbations without distorting the original dynamics of the infant movements. Our CP prediction model utilizes an ensemble approach, so we evaluate the XAI metrics performances for both the overall ensemble and the individual models. Our findings indicate that both XAI methods effectively identify key body points influencing CP predictions and that the explanations are robust against minor data perturbations. Grad-CAM significantly outperforms CAM in the RISv metric, which measures stability in terms of velocity. In contrast, CAM performs better in the RISb metric, which relates to bone stability, and the RRS metric, which assesses internal representation robustness. Individual models within the ensemble show varied results, and neither CAM nor Grad-CAM consistently outperform the other, with the ensemble approach providing a representation of outcomes from its constituent models.

脑瘫检测可解释AI深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。