提出新模型抑制卷积网络对纹理的依赖,提升对形状的识别能力。
Mitigating Shortcut Learning: Texture-Penalized Prototype Networks

- 通过惩罚局部纹理特征提取,强制网络关注全局形状结构。
- 将ResNet-50的纹理偏好从55.11%降至29.73%,优于ViT-B/16。
- 无需数据增强,在分布外场景下仍保持强形状判别力。
标准卷积神经网络(CNN)因强烈的纹理偏好而表现下降,该偏好过度依赖局部高频模式而非全局结构形状,导致在纹理变化或环境干扰下出现高置信度误分类。为此,本文提出纹理惩罚原型网络(TPPN),一种无需资源密集型数据增强的新架构。其纹理惩罚分支(TPB)对局部纹理代理的提取施加惩罚,迫使网络主干丢弃高频线索,提取纯净的、以形状为中心的表示。通过在最终卷积特征构成的原型超球体中评估相似性,该方法施加严格的几何约束,将物体视为关键部分的组合,实现鲁棒分类。在纹理-形状冲突数据集与合成噪声基准上的评估表明,该结构解耦显著增强了形状偏好。所提框架将基线ResNet-50的纹理偏差从55.11%降低至29.73%,优于现成视觉变换器(ViT-B/16)。此外,该方法在提示冲突条件下展现更强泛化能力,能有效抵抗分布外(OOD)形状下的纹理捷径学习,在扰动增强时仍保持较强形状准确率。在干净验证数据上,精度仅下降0.90个百分点。该方案提供了高效且结构性的解决CNN纹理偏见的方法。
原文摘要 · Abstract (English)
Standard Convolutional Neural Networks (CNNs) exhibit severe performance degradation due to a strong inductive texture bias that prioritizes local, high-frequency patterns over global structural shapes. This dependency causes confident misclassifications during textural changes or environmental effects. To address this flaw, this study introduces the Texture-Penalized Prototype Network (TPPN), a novel architectural framework that shifts this inherent bias without depending on resource-intensive augmented datasets. Specifically, a Texture-Penalization Branch (TPB) imposes a penalty to suppress the extraction of local texture proxies, forcing the network backbone to discard high-frequency cues and extract purified, shape-biased representations. By evaluating similarities within a prototype-based hypersphere derived from the final convolutional features, the approach enforces strict geometric constraints, treating objects as compositions of essential parts to achieve robust classification. Evaluations on texture-shape cue-conflict datasets and synthetic noise benchmarks demonstrate the stronger shape bias of this structural disentanglement. The proposed framework reduces the inherent texture bias of a baseline ResNet-50 from 55.11% to 29.73%, surpassing the texture-suppression capabilities of an off-the-shelf Vision Transformer (ViT-B/16). Furthermore, the approach demonstrates robust generalization under cue-conflict conditions, resisting textural shortcut learning when encountering Out-of-Distribution (OOD) shapes. The model maintains stronger shape accuracy against elevated perturbations. On clean validation data, the architecture incurs a minimal drop in accuracy of 0.90 percentage points. This provides a structural, efficient solution to CNN texture bias.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。