用博弈论方法解释医学影像分割模型对不同成像对比度的依赖程度。
Here Comes the Explanation: A Shapley Perspective on Multi-contrast Medical Image Segmentation
- 基于博弈论的对比度级归因法,分析模型对多对比度MRI的响应机制。
- U-Net过度依赖T1和FLAIR对比度,而Swin-UNETR呈现更均衡的跨对比度理解。
- 为脑肿瘤分割模型提供可解释性,适合临床医生验证模型决策逻辑。
深度学习在医学图像分割中已取得成功,能准确识别器官与病灶等感兴趣区域。该方法适用于单对比度、多对比度及多模态成像数据。为提升黑箱模型的可解释性,亟需可解释AI(XAI)技术以增强透明度与问责性。以往研究主要聚焦于后处理像素级解释,采用基于梯度或扰动的方法。然而这些方法在多对比度磁共振成像(MRI)分割任务中常因解释稀疏且复杂而难以满足临床需求。本研究提出使用对比度级Shapley值,解释在标准脑肿瘤分割指标上训练的先进模型行为。结果表明,Shapley分析揭示了模型行为的关键差异:U-Net表现出对T1和FLAIR对比度的过度偏好,而Swin-UNETR则展现出更均衡的跨对比度理解能力。
原文摘要 · Abstract (English)
Deep learning has been successfully applied to medical image segmentation, enabling accurate identification of regions of interest such as organs and lesions. This approach works effectively across diverse datasets, including those with single-image contrast, multi-contrast, and multimodal imaging data. To improve human understanding of these black-box models, there is a growing need for Explainable AI (XAI) techniques for model transparency and accountability. Previous research has primarily focused on post hoc pixel-level explanations, using methods gradient-based and perturbation-based apporaches. These methods rely on gradients or perturbations to explain model predictions. However, these pixel-level explanations often struggle with the complexity inherent in multi-contrast magnetic resonance imaging (MRI) segmentation tasks, and the sparsely distributed explanations have limited clinical relevance. In this study, we propose using contrast-level Shapley values to explain state-of-the-art models trained on standard metrics used in brain tumor segmentation. Our results demonstrate that Shapley analysis provides valuable insights into different models' behavior used for tumor segmentation. We demonstrated a bias for U-Net towards over-weighing T1-contrast and FLAIR, while Swin-UNETR provided a cross-contrast understanding with balanced Shapley distribution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。