提出不确定性感知的子集选择方法,提升模型解释在分布外情况下的稳定性。
Uncertainty-Aware Subset Selection for Robust Visual Explainability under Distribution Shifts
- 结合子模优化与梯度不确定性估计,无需额外训练。
- 在分布外场景下显著减少冗余和不稳定的解释结果。
- 适合需要可靠可解释性的实际视觉应用开发者。
基于子集选择的方法广泛用于解释深度视觉模型:通过突出最影响预测的图像区域,支持对象级解释。尽管在分布内(ID)设置下表现良好,其在分布外(OOD)条件下的行为仍不清晰。通过在多个ID-OOD数据集上的大量实验,我们发现现有子集选择方法的可靠性明显下降,产生冗余、不稳定且对不确定性敏感的解释。为此,我们提出一种框架,将子模子集选择与逐层梯度不确定性估计相结合,无需额外训练或辅助模型即可提升鲁棒性和保真度。该方法通过自适应权重扰动估计不确定性,并用其指导子模优化,确保所选子集具有多样性和信息量。实证评估表明,该框架不仅缓解了现有方法在OOD场景下的缺陷,还在ID设置中也取得改进。这些发现揭示了当前子集方法的局限性,并展示了不确定性驱动优化如何增强归因与对象级可解释性,为真实视觉应用中的透明可信AI铺平道路。
原文摘要 · Abstract (English)
Subset selection-based methods are widely used to explain deep vision models: they attribute predictions by highlighting the most influential image regions and support object-level explanations. While these methods perform well in in-distribution (ID) settings, their behavior under out-of-distribution (OOD) conditions remains poorly understood. Through extensive experiments across multiple ID-OOD sets, we find that reliability of the existing subset based methods degrades markedly, yielding redundant, unstable, and uncertainty-sensitive explanations. To address these shortcomings, we introduce a framework that combines submodular subset selection with layer-wise, gradient-based uncertainty estimation to improve robustness and fidelity without requiring additional training or auxiliary models. Our approach estimates uncertainty via adaptive weight perturbations and uses these estimates to guide submodular optimization, ensuring diverse and informative subset selection. Empirical evaluations show that, beyond mitigating the weaknesses of existing methods under OOD scenarios, our framework also yields improvements in ID settings. These findings highlight limitations of current subset-based approaches and demonstrate how uncertainty-driven optimization can enhance attribution and object-level interpretability, paving the way for more transparent and trustworthy AI in real-world vision applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。