为医学图像识别的解释结果提供不确定性量化,提升可信度。
UbiQVision: Quantifying Uncertainty in XAI for Image Recognition
- 结合狄利克雷后验采样与德普斯特-沙弗理论,量化SHAP解释的不确定性。
- 在三个医学影像数据集上验证,显著降低因模态差异带来的解释不稳定性。
- 适合医疗AI领域研究者,用于提升模型决策可解释性与可靠性。
深度学习在医疗影像等领域的广泛应用得益于更复杂的模型架构(如ResNets、Vision Transformers和混合卷积神经网络),但其复杂性削弱了模型的可解释性。SHAP作为主流可解释性方法,常因认知不确定性和随机不确定性导致解释结果不稳定。本文提出一种基于狄利克雷后验采样与德普斯特-沙弗理论的框架,通过信念、似然与融合图结合统计分析,对SHAP解释中的不确定性进行量化。该方法在三个具有不同类别分布、图像质量及模态类型(病理学、眼科、放射学)的医学影像数据集上进行了评估,这些数据因分辨率差异和模态特异性引入了显著的认知不确定性,验证了框架的有效性。
原文摘要 · Abstract (English)
Recent advances in deep learning have led to its widespread adoption across diverse domains, including medical imaging. This progress is driven by increasingly sophisticated model architectures, such as ResNets, Vision Transformers, and Hybrid Convolutional Neural Networks, that offer enhanced performance at the cost of greater complexity. This complexity often compromises model explainability and interpretability. SHAP has emerged as a prominent method for providing interpretable visualizations that aid domain experts in understanding model predictions. However, SHAP explanations can be unstable and unreliable in the presence of epistemic and aleatoric uncertainty. In this study, we address this challenge by using Dirichlet posterior sampling and Dempster-Shafer theory to quantify the uncertainty that arises from these unstable explanations in medical imaging applications. The framework uses a belief, plausible, and fusion map approach alongside statistical quantitative analysis to produce quantification of uncertainty in SHAP. Furthermore, we evaluated our framework on three medical imaging datasets with varying class distributions, image qualities, and modality types which introduces noise due to varying image resolutions and modality-specific aspect covering the examples from pathology, ophthalmology, and radiology, introducing significant epistemic uncertainty.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。