用SHAP解释骨骼数据动作识别模型,验证关键点影响。
Explaining Human Activity Recognition with SHAP: Validating Insights with Perturbation and Quantitative Measures
- 用SHAP分析图卷积网络在动作识别中的决策依据。
- 重要关节点扰动后准确率下降,证明其对预测影响显著。
- 适合医疗、康复等高风险场景的可解释模型研究者。
在人体活动识别(HAR)中,理解高风险应用中身体运动的复杂性至关重要。本研究采用SHapley Additive exPlanations(SHAP)解释图卷积网络(GCNs)在骨架数据上进行动作分类时的决策过程。使用两个真实数据集:一个用于脑瘫(CP)分类,另一个是广泛使用的NTU RGB+D 60动作识别数据集。为验证解释效果,提出一种新扰动方法,修改模型的边重要性矩阵,评估特定身体关键点对预测结果的影响。通过有信息量的扰动(针对SHAP识别的重要关键点)与随机扰动对比,判断关键点是否真正影响预测。两个数据集的结果均显示,SHAP识别的重要身体关键点对准确率、特异性和敏感性指标影响最大。研究证实SHAP能提供GCN在HAR任务中输入特征贡献的细粒度洞察,推动医疗与康复等高风险场景中更可解释、可信的模型发展。
原文摘要 · Abstract (English)
In Human Activity Recognition (HAR), understanding the intricacy of body movements within high-risk applications is essential. This study uses SHapley Additive exPlanations (SHAP) to explain the decision-making process of Graph Convolution Networks (GCNs) when classifying activities with skeleton data. We employ SHAP to explain two real-world datasets: one for cerebral palsy (CP) classification and the widely used NTU RGB+D 60 action recognition dataset. To test the explanation, we introduce a novel perturbation approach that modifies the model's edge importance matrix, allowing us to evaluate the impact of specific body key points on prediction outcomes. To assess the fidelity of our explanations, we employ informed perturbation, targeting body key points identified as important by SHAP and comparing them against random perturbation as a control condition. This perturbation enables a judgment on whether the body key points are truly influential or non-influential based on the SHAP values. Results on both datasets show that body key points identified as important through SHAP have the largest influence on the accuracy, specificity, and sensitivity metrics. Our findings highlight that SHAP can provide granular insights into the input feature contribution to the prediction outcome of GCNs in HAR tasks. This demonstrates the potential for more interpretable and trustworthy models in high-stakes applications like healthcare or rehabilitation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。