不依赖生成模型,直接用因果证据生成医学图像反事实样本
Generating Medical Image Counterfactuals using Causal Explanations
- 基于分类器提取的因果证据构造反事实图像,无需额外生成模型
- 在真实医疗数据集上成功改变分类结果,且与原图更接近
- 方法确定性强、可控制编辑区域,适合需要透明决策解释的场景
深度学习模型在医学影像诊断中表现优异,但临床应用受限于可解释性不足。反事实图像可通过展示图像如何变化才能改变分类结果,来审计模型行为。现有方法通常借助生成对抗网络或扩散模型等辅助模型生成,虽视觉逼真,却用一个黑箱解释另一个黑箱,难以区分分类器决策与生成器的归纳偏置。本文提出一种新框架,无需生成模型,直接从分类器中提取因果证据构建反事实图像。该方法确定性高、无需额外训练,支持用户指定区域内可控编辑。在真实医疗影像数据集上的实验表明,该方法能有效改变分类结果,且生成图像更贴近原图,为理解分类器决策边界提供了更直接、透明的视角。
原文摘要 · Abstract (English)
Deep learning models have achieved impressive performance in medical image diagnosis, yet their deployment in clinical settings remains constrained by limited explainability. Counterfactual images provide one means of auditing model behavior by showing how an image would need to change for a classifier to produce a different prediction. Existing approaches typically generate such explanations using auxiliary models, including generative adversarial networks and diffusion models. While often capable of producing visually realistic images, these methods explain one black-box model using another, making it difficult to separate the classifier's decision-making process from the inductive biases of the generator. We propose a novel counterfactual-generation framework that requires no generative model. Instead, counterfactuals are constructed directly from causal evidence extracted from the classifier. The resulting approach is deterministic, requires no additional model training, and enables controllable edits within user-specified regions of interest. Experiments on real-world medical imaging datasets demonstrate that the proposed method successfully changes classifier predictions while remaining closer to the original image than generative baselines, providing a more direct and transparent view of the classifier's decision boundary.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。