通过自监督掩码提升模型对真实特征的依赖,让决策更可解释且准确。
AIM: Amending Inherent Interpretability via Self-Supervised Masking
- 利用多阶段编码特征引导自监督样本特异性掩码。
- 在多个数据集上同时提升可解释性(EPG)与分类准确率。
- 无需额外标注,适用于多种模型与任务场景。
深度神经网络常同时使用真实特征和虚假特征。本文提出一种名为AIM(Amending Inherent Interpretability via Self-Supervised Masking)的方法,通过自监督掩码机制,在不需额外标注的前提下,促使网络更倾向于使用真实特征而非虚假特征。AIM利用多编码阶段的特征,指导样本特异性的自监督掩码过程,从而训练出既性能优异又具备内在可解释性的模型。我们在多个具有挑战性的数据集上验证了该方法,涵盖ImageNet100、HardImageNet、ImageWoof等通用分类任务,以及Waterbirds、TravelingBirds、CUB-200等细粒度分类任务。实验表明,AIM在多个领域和架构中均显著提升可解释性(以能量指向游戏分数衡量)并取得更高的准确率,证明其能有效促进真实有意义特征的使用,增强泛化能力与人类可理解的解释性。
原文摘要 · Abstract (English)
It has been observed that deep neural networks (DNNs) often use both genuine as well as spurious features. In this work, we propose "Amending Inherent Interpretability via Self-Supervised Masking" (AIM), a simple yet interestingly effective method that promotes the network's utilization of genuine features over spurious alternatives without requiring additional annotations. In particular, AIM uses features at multiple encoding stages to guide a self-supervised, sample-specific feature-masking process. As a result, AIM enables the training of well-performing and inherently interpretable models that faithfully summarize the decision process. We validate AIM across a diverse range of challenging datasets that test both out-of-distribution generalization and fine-grained visual understanding. These include general-purpose classification benchmarks such as ImageNet100, HardImageNet, and ImageWoof, as well as fine-grained classification datasets such as Waterbirds, TravelingBirds, and CUB-200. AIM demonstrates significant dual benefits: interpretability improvements, as measured by the Energy Pointing Game (EPG) score, and accuracy gains over strong baselines. These consistent gains across domains and architectures provide compelling evidence that AIM promotes the use of genuine and meaningful features that directly contribute to improved generalization and human-aligned interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。