arXiv:2410.23072cs.CVcs.AI2024-10

提出多向量张量分解方法,提升自监督CNN的可解释性。

CNN Explainability with Multivector Tucker Saliency Maps for Self-Supervised Models

  • 用张量分解捕捉特征图结构,生成更精准显著图。
  • 相比EigenCAM,解释能力提升约50%,在自监督模型上最优。
  • 适用于无标签场景,适合研究模型决策机制者。

解释卷积神经网络(CNN)的决策对理解其行为至关重要,但尤其在自监督模型中仍具挑战。现有显著图生成方法大多依赖真实标签,仅限于有监督任务。EigenCAM是唯一显著的无标签替代方案,利用奇异值分解生成通用显著图,但未充分挖掘特征图的张量结构。本文提出Tucker显著图(TSM)方法,通过张量分解更有效地捕捉特征图的内在结构,生成更准确的奇异向量与值,从而生成高保真显著图,有效突出输入中的关注对象。进一步将EigenCAM与TSM扩展为多向量变体——Multivec-EigenCAM与多向量Tucker显著图(MTSM),利用所有奇异向量与值,进一步提升显著图质量。定量评估显示,TSM、Multivec-EigenCAM与MTSM在有监督分类模型上性能媲美依赖标签的方法。此外,TSM在自监督与有监督模型上相较EigenCAM提升约50%的可解释性。Multivec-EigenCAM与MTSM在自监督模型上进一步超越当前最佳,其中MTSM表现最优。

原文摘要 · Abstract (English)

Interpreting the decisions of Convolutional Neural Networks (CNNs) is essential for understanding their behavior, yet explainability remains a significant challenge, particularly for self-supervised models. Most existing methods for generating saliency maps rely on ground truth labels, restricting their use to supervised tasks. EigenCAM is the only notable label-independent alternative, leveraging Singular Value Decomposition to generate saliency maps applicable across CNN models, but it does not fully exploit the tensorial structure of feature maps. In this work, we introduce the Tucker Saliency Map (TSM) method, which applies Tucker tensor decomposition to better capture the inherent structure of feature maps, producing more accurate singular vectors and values. These are used to generate high-fidelity saliency maps, effectively highlighting objects of interest in the input. We further extend EigenCAM and TSM into multivector variants -Multivec-EigenCAM and Multivector Tucker Saliency Maps (MTSM)- which utilize all singular vectors and values, further improving saliency map quality. Quantitative evaluations on supervised classification models demonstrate that TSM, Multivec-EigenCAM, and MTSM achieve competitive performance with label-dependent methods. Moreover, TSM enhances explainability by approximately 50% over EigenCAM for both supervised and self-supervised models. Multivec-EigenCAM and MTSM further advance state-of-the-art explainability performance on self-supervised models, with MTSM achieving the best results.

可解释性张量分解自监督学习显著图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。