用部件贡献度解释人体绘画评估模型决策,更直观可信。
PCEvE: Part Contribution Evaluation Based Model Explanation for Human Figure Drawing Assessment and Beyond
- 基于部件检测与Shapley值,量化各身体部位对判断的贡献
- 在多个人体绘画数据集上验证,有效提升决策可解释性
- 适用范围从绘画评估扩展至汽车图像等其他领域
在自动人体绘画(HFD)评估任务中,如通过绘画图像诊断自闭症谱系障碍(ASD),模型决策的清晰性与可解释性至关重要。现有像素级归因类可解释AI(XAI)方法需用户大量人力解读图像区域的语义信息,常耗时且不实用。为此,我们提出基于部件贡献评估的模型解释框架(PCEvE)。在部件检测基础上,计算每个身体部位的Shapley值以评估其对模型决策的贡献。与传统归因方法不同,PCEvE提供直观的部件贡献直方图作为解释。此外,该方法将解释范围从样本级拓展至类别级和任务级,实现对模型行为更全面的理解。我们在多个HFD评估数据集上进行了广泛实验验证,并通过控制实验进行合理性检验。同时,将该方法应用于真实照片数据集Stanford Cars,证明其在其他领域的通用性与适用性。
原文摘要 · Abstract (English)
For automatic human figure drawing (HFD) assessment tasks, such as diagnosing autism spectrum disorder (ASD) using HFD images, the clarity and explainability of a model decision are crucial. Existing pixel-level attribution-based explainable AI (XAI) approaches demand considerable effort from users to interpret the semantic information of a region in an image, which can be often time-consuming and impractical. To overcome this challenge, we propose a part contribution evaluation based model explanation (PCEvE) framework. On top of the part detection, we measure the Shapley Value of each individual part to evaluate the contribution to a model decision. Unlike existing attribution-based XAI approaches, the PCEvE provides a straightforward explanation of a model decision, i.e., a part contribution histogram. Furthermore, the PCEvE expands the scope of explanations beyond the conventional sample-level to include class-level and task-level insights, offering a richer, more comprehensive understanding of model behavior. We rigorously validate the PCEvE via extensive experiments on multiple HFD assessment datasets. Also, we sanity-check the proposed method with a set of controlled experiments. Additionally, we demonstrate the versatility and applicability of our method to other domains by applying it to a photo-realistic dataset, the Stanford Cars.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。