提出SFAM方法,让度量学习模型的决策过程可解释。
Visual Explanation via Similar Feature Activation for Metric Learning
- 用特征相似性计算通道重要性得分,替代传统分类层依赖。
- 在欧氏距离和余弦相似度下均生成清晰的可视化解释图。
- 适合需要理解度量学习模型决策逻辑的研究者使用。
视觉解释图能提升深度学习模型决策的可信度,并为图像识别算法设计提供有益指导。类激活图(CAM)及其变体(如Grad-CAM、Relevance-CAM)广泛用于基于Softmax的卷积神经网络的可解释性分析,但这类方法依赖全连接层作为分类器,无法直接应用于无全连接层的度量学习模型。为此,本文提出一种新型视觉解释方法——相似特征激活图(SFAM)。该方法引入通道级贡献重要性评分(CIS),通过计算两个图像嵌入之间的相似性来衡量特征重要性,再将该重要性权重线性叠加至CNN的特征图上生成解释图。定量与定性实验表明,SFAM在以欧氏距离或余弦相似度为度量标准的CNN模型中,均能提供高度可信的可解释视觉解释。
原文摘要 · Abstract (English)
Visual explanation maps enhance the trustworthiness of decisions made by deep learning models and offer valuable guidance for developing new algorithms in image recognition tasks. Class activation maps (CAM) and their variants (e.g., Grad-CAM and Relevance-CAM) have been extensively employed to explore the interpretability of softmax-based convolutional neural networks, which require a fully connected layer as the classifier for decision-making. However, these methods cannot be directly applied to metric learning models, as such models lack a fully connected layer functioning as a classifier. To address this limitation, we propose a novel visual explanation method termed Similar Feature Activation Map (SFAM). This method introduces the channel-wise contribution importance score (CIS) to measure feature importance, derived from the similarity measurement between two image embeddings. The explanation map is constructed by linearly combining the proposed importance weights with the feature map from a CNN model. Quantitative and qualitative experiments show that SFAM provides highly promising interpretable visual explanations for CNN models using Euclidean distance or cosine similarity as the similarity metric.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。