SCAN统一生成高保真视觉解释,适配CNN与Transformer。
SCAN: Visual Explanations with Self-Confidence and Analysis Networks
- 用自编码器重构中间特征,结合信息瓶颈生成信心图。
- 在AUC-D、Drop%等指标上显著优于现有方法。
- 解释清晰聚焦物体,适合跨架构模型可解释性分析。
可解释人工智能(XAI)在计算机视觉中至关重要,使深度学习模型的决策过程透明化。然而,当前视觉解释方法在特定架构高保真度与通用性之间存在关键权衡,常导致解释抽象或碎片化,难以在不同模型族(如CNN与Transformer)间比较解释能力。本文提出自信心与分析网络(SCAN),一种新型通用框架,适用于卷积神经网络和Transformer架构。SCAN采用基于自编码器的方法重构模型中间层特征,依据信息瓶颈原理生成高分辨率自信心图,识别信息丰富区域。在多种架构和数据集上的大量实验表明,SCAN在AUC-D、负向AUC、Drop%和Win%等定量指标上持续表现优异;定性结果显示,其解释明显更清晰、聚焦于物体。SCAN提供了一个兼具架构通用性与高保真度的统一框架,增强了模型透明性,为理解复杂神经网络的决策过程提供了更可靠的工具。
原文摘要 · Abstract (English)
Explainable AI (XAI) has become essential in computer vision to make the decision-making processes of deep learning models transparent. However, current visual explanation (XAI) methods face a critical trade-off between the high fidelity of architecture-specific methods and the broad applicability of universal ones. This often results in abstract or fragmented explanations and makes it difficult to compare explanatory power across diverse model families, such as CNNs and Transformers. This paper introduces the Self-Confidence and Analysis Networks (SCAN), a novel universal framework that overcomes these limitations for both convolutional neural network and transformer architectures. SCAN utilizes an AutoEncoder-based approach to reconstruct features from a model's intermediate layers. Guided by the Information Bottleneck principle, it generates a high-resolution Self-Confidence Map that identifies information-rich regions. Extensive experiments on diverse architectures and datasets demonstrate that SCAN consistently achieves outstanding performance on various quantitative metrics such as AUC-D, Negative AUC, Drop%, and Win%. Qualitatively, it produces significantly clearer, object-focused explanations than existing methods. By providing a unified framework that is both architecturally universal and highly faithful, SCAN enhances model transparency and offers a more reliable tool for understanding the decision-making processes of complex neural networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。