不依赖分类器生成医学图像反事实解释,更少受模型偏差影响。
Counterfactual Contrastive Analysis

- 基于对比分析,从数据分布中分离出关键特征并交换
- 在三个医学影像数据集上生成质量更高的反事实图像
- 适合医疗诊断可解释性研究,尤其关注模型公平性
视觉反事实解释(VCE)旨在通过生成最小修改且真实的输入图像版本来解释图像分类器的预测结果。现有方法本质上依赖分类器,因此易受分类器偏差和缺陷(如对捷径特征敏感、校准误差)的影响。本文提出一种无需分类器的视觉反事实生成方法,基于对比分析(CA)。给定两个对应不同类别的数据集(如健康与患者),我们分离出跨数据集共有的生成因素与各数据集特有的显著因素,并仅通过交换显著因素生成反事实图像。该方法直接作用于数据分布而非决策边界,实现模型无关的VCE,降低对分类器偏差的敏感性。利用StyleGAN2的高质量合成能力和结构化隐空间,采用特征空间F而非传统W空间以提升细节保留。不同于传统对比分析通常假设仅一个数据集存在显著因素,本文引入适配框架与损失函数,支持每个数据集包含多个显著因素。在三个医学影像数据集上评估,结果表明本方法生成的反事实图像质量优于现有方法。
原文摘要 · Abstract (English)
Visual Counterfactual Explanations (VCEs) aim to explain image classifiers by generating minimally edited and realistic versions of an input image that change the classifier's prediction. Existing VCE methods are inherently classifier-dependent and therefore susceptible to classifier biases and failure modes, such as sensitivity to shortcut features and calibration errors. In this paper, we propose a classifier-free approach for visual counterfactual generation based on Contrastive Analysis (CA). Given two datasets corresponding to different classes (e.g., healthy and patients), we disentangle the generative factors that are common across the two datasets from those that are salient to each dataset, and generate counterfactual images by swapping only the salient factors. By operating directly on data distributions rather than decision boundaries, our method provides model-agnostic VCEs that are less sensitive to classifier biases. Our approach leverages the high-quality synthesis and well-structured latent space of StyleGAN2. We use the feature space F, instead than the usual W-space, to improve detail preservation. Unlike conventional CA approaches, which typically assume salient factors in only one dataset, we introduce an adapted framework and loss functions for VCE that allow multiple salient factors in each dataset. We evaluate our method on three medical imaging datasets and demonstrate superior counterfactual generation quality compared to existing approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。