通过对比相似类别,精准定位图像中区分性细节。
Finer-CAM: Spotting the Difference Reveals Finer Details for Visual Explanation
- 对比目标类与相似类,找出差异区域以提升定位精度
- 仅屏蔽前5%激活像素就导致显著置信度下降,优于基线方法
- 兼容多种CAM方法,支持粗略轮廓到精细特征的灵活调节
类激活图(CAM)被广泛用于突出图像中影响分类决策的区域。尽管其结构简单、计算高效,但在区分视觉上相似的细粒粒度类别时表现不佳。现有方法虽通过引入更复杂的解释过程改进性能,却增加了额外复杂度。本文提出Finer-CAM,保留CAM的高效性的同时实现对区分性区域的精确定位。核心思想是:CAM的不足不在于解释方式,而在于解释内容——以往方法关注所有对目标类得分有贡献的线索,无意中也激活了与其他相似类别共享的区域。通过显式比较目标类与相似类并识别其差异,Finer-CAM抑制共现特征,强化目标类独有的判别细节。该方法易于实现,兼容多种CAM方法,并可扩展至多模态模型以精确定位特定概念。此外,支持调节对比强度,用户可选择强调粗略轮廓或精细判别特征。定量实验表明,仅屏蔽前5%激活像素,其带来的置信度相对下降幅度大于基线方法。
原文摘要 · Abstract (English)
Class activation map (CAM) has been widely used to highlight image regions that contribute to class predictions. Despite its simplicity and computational efficiency, CAM often struggles to identify discriminative regions that distinguish visually similar fine-grained classes. Prior efforts address this limitation by introducing more sophisticated explanation processes, but at the cost of extra complexity. In this paper, we propose Finer-CAM, a method that retains CAM's efficiency while achieving precise localization of discriminative regions. Our key insight is that the deficiency of CAM lies not in "how" it explains, but in "what" it explains. Specifically, previous methods attempt to identify all cues contributing to the target class's logit value, which inadvertently also activates regions predictive of visually similar classes. By explicitly comparing the target class with similar classes and spotting their differences, Finer-CAM suppresses features shared with other classes and emphasizes the unique, discriminative details of the target class. Finer-CAM is easy to implement, compatible with various CAM methods, and can be extended to multi-modal models for accurate localization of specific concepts. Additionally, Finer-CAM allows adjustable comparison strength, enabling users to selectively highlight coarse object contours or fine discriminative details. Quantitatively, we show that masking out the top 5% of activated pixels by Finer-CAM results in a larger relative confidence drop compared to baselines. The source code and demo are available at https://github.com/Imageomics/Finer-CAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。