arXiv:2604.06893cs.CVcs.LG2026-04

通过能量最小化自动选择关键区域,提升视觉模型鲁棒性与可解释性。

Energy-Regularized Spatial Masking: A Novel Approach to Enhancing Robustness and Interpretability in Vision Models

  • 将特征选择建模为可微能量优化问题,动态生成空间掩码。
  • 在不降精度前提下实现抗遮挡增强与自动生成可解释掩码。
  • 适合追求模型透明度与抗干扰能力的研究者使用。

深度卷积神经网络通过密集处理空间特征图取得优异性能,但这种粗暴策略导致显著计算冗余,并加剧对无关背景相关性的依赖,使现代视觉模型仍脆弱且难解释。本文提出能量正则化空间掩码(ERSM),将特征选择重构为可微能量最小化问题。在标准卷积主干中嵌入轻量级能量掩码层,每个视觉令牌被赋予由内在一元重要性代价与成对空间一致性惩罚构成的标量能量。不同于以往强制稀疏预算或依赖启发式重要性评分的方法,ERSM使网络自主发现适配输入的最优信息密度平衡。我们在卷积架构上验证了该方法,结果表明其能产生涌现稀疏性、提升对结构化遮挡的鲁棒性,并生成高度可解释的空间掩码,同时保持分类准确率。此外,学习到的能量排序在删除测试中显著优于基于幅度的剪枝,揭示了ERSM作为内在去噪机制,可在无像素级监督下识别语义物体区域。

原文摘要 · Abstract (English)

Deep convolutional neural networks achieve remarkable performance by exhaustively processing dense spatial feature maps, yet this brute-force strategy introduces significant computational redundancy and encourages reliance on spurious background correlations. As a result, modern vision models remain brittle and difficult to interpret. We propose Energy-Regularized Spatial Masking (ERSM), a novel framework that reformulates feature selection as a differentiable energy minimization problem. By embedding a lightweight Energy-Mask Layer inside standard convolutional backbones, each visual token is assigned a scalar energy composed of two competing forces: an intrinsic Unary importance cost and a Pairwise spatial coherence penalty. Unlike prior pruning methods that enforce rigid sparsity budgets or rely on heuristic importance scores, ERSM allows the network to autonomously discover an optimal information-density equilibrium tailored to each input. We validate ERSM on convolutional architectures and demonstrate that it produces emergent sparsity, improved robustness to structured occlusion, and highly interpretable spatial masks, while preserving classification accuracy. Furthermore, we show that the learned energy ranking significantly outperforms magnitude-based pruning in deletion-based robustness tests, revealing ERSM as an intrinsic denoising mechanism that isolates semantic object regions without pixel-level supervision.

视觉模型可解释性稀疏性鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。