用自然语言解释视觉模型关注点,让决策理由更清晰。
TextCAM: Explaining Class Activation Map with Text
- 结合CAM空间定位与视觉语言模型语义对齐
- 生成与注意力区域对应的可读文字说明
- 适合需要透明决策解释的高风险场景
深度神经网络在多个领域表现卓越,但可解释性差,限制了其在高风险场景中的可信度。本文聚焦于视觉模型,针对主流解释方法类激活映射(CAM)缺乏语义信息的问题,提出TextCAM框架。该框架将CAM的空间定位能力与视觉-语言模型(VLM)的语义对齐能力结合,通过CLIP嵌入和线性判别分析提取通道级语义表示,并与CAM权重融合,生成对显著视觉证据的文字描述。这使得解释能同时说明模型关注的位置及其支持判断的视觉属性。进一步地,TextCAM可将特征通道聚合成语义连贯组,实现更细粒度的图文解释。在ImageNet、CLEVR和CUB数据集上的实验表明,TextCAM生成的解释忠实且可读性强,有助于提升人类理解、检测虚假关联,并保持模型原有效果。
原文摘要 · Abstract (English)
Deep neural networks (DNNs) have achieved remarkable success across domains but remain difficult to interpret, limiting their trustworthiness in high-stakes applications. This paper focuses on deep vision models, for which a dominant line of explainability methods are Class Activation Mapping (CAM) and its variants working by highlighting spatial regions that drive predictions. We figure out that CAM provides little semantic insight into what attributes underlie these activations. To address this limitation, we propose TextCAM, a novel explanation framework that enriches CAM with natural languages. TextCAM combines the precise spatial localization of CAM with the semantic alignment of vision-language models (VLMs). Specifically, we derive channel-level semantic representations using CLIP embeddings and linear discriminant analysis, and aggregate them with CAM weights to produce textual descriptions of salient visual evidence. This yields explanations that jointly specify where the model attends and what visual attributes likely support its decision. We further extend TextCAM to generate feature channels into semantically coherent groups, enabling more fine-grained visual-textual explanations. Experiments on ImageNet, CLEVR, and CUB demonstrate that TextCAM produces faithful and interpretable rationales that improve human understanding, detect spurious correlations, and preserve model fidelity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。