arXiv:2511.12992cs.CV2025-11

提升视觉反事实解释的语义相关性,让编辑更精准高效。

Semantic Prioritization in Visual Counterfactual Explanations with Weighted Segmentation and Auto-Adaptive Region Selection

  • 通过加权语义图筛选关键区域,减少无效计算。
  • 自适应调整编辑顺序,保持替换区域与目标物体语义一致。
  • 适合需要高可解释性的图像编辑与AI决策分析场景。

在非生成式视觉反事实解释领域,传统方法常将查询图像的部分区域替换为干扰图像中的对应区域,却忽视了替换区域与目标物体的语义相关性,影响模型可解释性并拖慢编辑流程。本文提出Weighted Semantic Map with Auto-adaptive Candidate Editing Network(WSAE-Net),包含两项核心改进:一是生成加权语义图,以最小化需计算的非语义特征单元,提升计算效率;二是设计自适应候选编辑序列,动态确定特征单元的最优处理顺序,在保证替换区域与目标物体语义一致的前提下,实现高效反事实生成。大量实验表明,该方法显著提升解释清晰度与深度。

原文摘要 · Abstract (English)

In the domain of non-generative visual counterfactual explanations (CE), traditional techniques frequently involve the substitution of sections within a query image with corresponding sections from distractor images. Such methods have historically overlooked the semantic relevance of the replacement regions to the target object, thereby impairing the model's interpretability and hindering the editing workflow. Addressing these challenges, the present study introduces an innovative methodology named as Weighted Semantic Map with Auto-adaptive Candidate Editing Network (WSAE-Net). Characterized by two significant advancements: the determination of an weighted semantic map and the auto-adaptive candidate editing sequence. First, the generation of the weighted semantic map is designed to maximize the reduction of non-semantic feature units that need to be computed, thereby optimizing computational efficiency. Second, the auto-adaptive candidate editing sequences are designed to determine the optimal computational order among the feature units to be processed, thereby ensuring the efficient generation of counterfactuals while maintaining the semantic relevance of the replacement feature units to the target object. Through comprehensive experimentation, our methodology demonstrates superior performance, contributing to a more lucid and in-depth understanding of visual counterfactual explanations.

反事实解释语义相关性图像编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。