用双分支Sigmoid结构改进注意力图,让模型解释更准确且不丢精度。
Beyond Softmax: Dual-Branch Sigmoid Architecture for Accurate Class Activation Maps
- 用平行Sigmoid分支分离定位与分类,避免Softmax带来的偏差
- 在多个数据集上提升定位精度,且分类准确率不变
- 适用于主流CAM方法,只需微调,开销极小
类激活映射(CAM)及其扩展已成为可视化深度网络预测依据的不可或缺工具。然而,依赖最终的Softmax分类器导致两个根本性失真:加性logit偏移任意扭曲重要性评分,符号坍缩混淆了兴奋与抑制特征。本文提出一种简单、与架构无关的双分支Sigmoid头,将定位与分类解耦。给定任意预训练模型,将其分类头克隆为并行分支,以每类Sigmoid输出结尾,冻结原Softmax头,仅用类别平衡的二元监督微调Sigmoid分支。推理时,Softmax保持识别准确率,而类证据图由Sigmoid分支生成——保留特征贡献的大小和符号。该方法可无缝集成至多数CAM变体,开销极小。在细粒度任务(CUB-200-2011、Stanford Cars)和弱监督定位基准(ImageNet-1K、OpenImages30K)上的大量实验表明,解释保真度提升,定位精度一致提高,且分类准确率无下降。代码已公开于https://github.com/finallyupper/beyond-softmax。
原文摘要 · Abstract (English)
Class Activation Mapping (CAM) and its extensions have become indispensable tools for visualizing the evidence behind deep network predictions. However, by relying on a final softmax classifier, these methods suffer from two fundamental distortions: additive logit shifts that arbitrarily bias importance scores, and sign collapse that conflates excitatory and inhibitory features. We propose a simple, architecture-agnostic dual-branch sigmoid head that decouples localization from classification. Given any pretrained model, we clone its classification head into a parallel branch ending in per-class sigmoid outputs, freeze the original softmax head, and fine-tune only the sigmoid branch with class-balanced binary supervision. At inference, softmax retains recognition accuracy, while class evidence maps are generated from the sigmoid branch -- preserving both magnitude and sign of feature contributions. Our method integrates seamlessly with most CAM variants and incurs negligible overhead. Extensive evaluations on fine-grained tasks (CUB-200-2011, Stanford Cars) and WSOL benchmarks (ImageNet-1K, OpenImages30K) show improved explanation fidelity and consistent Top-1 Localization gains -- without any drop in classification accuracy. Code is available at https://github.com/finallyupper/beyond-softmax.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。