让医生能精准干预医学影像模型决策,解释更直观。
Interactive Medical Image Analysis with Concept-based Similarity Reasoning
- 用可解释的局部原型定位概念激活区域,实现像素级推理
- 在三个生物医学数据集上提升4.5%性能,优于现有可解释方法
- 支持医生直接点击图像区域互动,适合临床辅助诊断场景
在临床流程中,解释并干预计算机辅助诊断模型的决策能力至关重要。现有基于概念的方法虽能关联模型预测与可解释概念,但概念层级停留在图像层面,难以精确定位其激活的具体区域。原型方法则通过训练图像块学习表征,并以相似度进行分类,但其底层概念解释困难,常需事后猜测。为此,本文提出概念相似性推理网络(CSR),具备(i)具有内在概念解释的块级原型,以及(ii)空间级交互能力。首先,该模型通过将每个概念的原型锚定在图像特定区域,提供局部化解释;其次,引入新型空间级交互机制,使医生可直接与图像特定区域互动,构建直观透明的医学影像分析工具。CSR在三个生物医学数据集上相较现有最先进可解释方法性能提升最高达4.5%。代码已开源:https://github.com/tadeephuy/InteractCSR。
原文摘要 · Abstract (English)
The ability to interpret and intervene model decisions is important for the adoption of computer-aided diagnosis methods in clinical workflows. Recent concept-based methods link the model predictions with interpretable concepts and modify their activation scores to interact with the model. However, these concepts are at the image level, which hinders the model from pinpointing the exact patches the concepts are activated. Alternatively, prototype-based methods learn representations from training image patches and compare these with test image patches, using the similarity scores for final class prediction. However, interpreting the underlying concepts of these patches can be challenging and often necessitates post-hoc guesswork. To address this issue, this paper introduces the novel Concept-based Similarity Reasoning network (CSR), which offers (i) patch-level prototype with intrinsic concept interpretation, and (ii) spatial interactivity. First, the proposed CSR provides localized explanation by grounding prototypes of each concept on image regions. Second, our model introduces novel spatial-level interaction, allowing doctors to engage directly with specific image areas, making it an intuitive and transparent tool for medical imaging. CSR improves upon prior state-of-the-art interpretable methods by up to 4.5\% across three biomedical datasets. Our code is released at https://github.com/tadeephuy/InteractCSR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。