用反事实生成模型揭示医学影像中被误判的关键区域。
Seeing What Shouldn't Be There: Counterfactual GANs for Medical Image Attribution

- 基于对抗生成网络构建反事实解释,模拟'若无某特征则结果不同'
- 在结核病和BraTS等数据集上验证,可生成可信的反事实图像
- 适合医学影像分析与可解释性研究者参考
图像归因能揭示影响图像分类或像素归属特定类别的关键物体。现有可视化方法多依赖判别模型,仅突出分类所依赖的最小特征集,忽略其他显著物体。为此,提出一种基于反事实解释(CX)的类别导向特征归因方法。该方法利用生成对抗网络(GAN)结合循环一致性损失,实现因果推理:'若某特征不存在,则结果将改变'。在合成数据、结核病数据集及BraTS数据集上均验证了方法有效性。研究还指出当前反事实解释技术生成的反事实实例(CI)往往不自然,因此提出新型CI生成方法,并引入新评估技术衡量其质量。基线实验在BraTS数据集上完成。
原文摘要 · Abstract (English)
Ascription of an image gives insights into the objects that influence the classification of the whole image or its pixels towards a specific category. These insights help radiologists to visualize deformities in medical imaging. Most of the existing visualization techniques are based on discriminative models and highlight regions of the input image participating in the decision-making of a classifier. However, these approaches do not take all noticeable objects into account as their objective is to classify the input by using a minimal set of discriminative features. To overcome the issue, a counterfactual explanation (CX) based class-oriented feature attribution method is proposed. A counterfactual explanation (CX) explicates a causal reasoning process of the form: "if X had not happened, then Y would not have happened". The method is built on generative adversarial networks (GANs) with a cyclical-consistent loss function. We evaluate our method on three datasets: synthetic, tuberculosis and BraTS. All experiments confirm the efficacy of the proposed method. This study also highlighted the limitations of existing counterfactual explanation techniques in producing plausible counterfactual instances (CIs). Accompanying CXs with believable CIs thus provides self-explanatory analogy-based explanations. To this end, a CI generation method is proposed. Also, a novel technique is used to evaluate the quality of CI. The baseline results are produced on the BraTS dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。