通过插入全局平均池化层,让CNN模型更抗位置变化且大幅减少参数。
Parameter-Efficient Architectural Modifications for Translation-Invariant CNNs

- 在不同深度插入全局平均池化层,解耦特征与空间位置的关系。
- 参数量从520万减至8.2万,网络大小从138M降至14M,准确率仍达66.4%。
- 适合追求轻量化、高鲁棒性的模型设计,尤其适用于图像质量评估任务。
卷积神经网络通常被认为具备平移不变性,但标准架构存在显著脆弱性:仅一个像素的偏移就可能导致性能急剧下降,原因在于其依赖空间相关的全连接层。本文提出一种轻量级‘在线架构’策略,通过在不同网络深度插入全局平均池化(GAP)层,有效解耦特征识别与空间位置。以VGG-16为例,该修改使可训练参数减少98%(从520万降至8.2万),总网络规模减少90%(从138M降至14M)。尽管大幅压缩,模型在ImageNet上保持66.4%的Top-1准确率,且平移鲁棒性翻倍,平均相对损失从0.09降至0.05。分析发现,虽GAP缓解宏观敏感性,但离散池化仍引入周期性混叠,无法实现像素级稳定。进一步将该不变性结构融入LPIPS框架用于感知图像质量评估,在KADID-10k数据集上泛化性能显著优于基线(斯皮尔曼相关0.89 vs. 0.75),在RAID数据集上与人类心理物理响应曲线近乎完美对齐(斯皮尔曼0.95)。结果表明,通过架构设计实现不变性比传统数据增强更高效、更符合生物机制。代码与数据公开可用。
原文摘要 · Abstract (English)
Convolutional Neural Networks (CNNs) are widely assumed to be translation-invariant, yet standard architectures exhibit a startling fragility: even a single-pixel shift can drastically degrade performance due to their reliance on spatially dependent fully connected layers. In this work, we resolve this vulnerability by proposing a lightweight 'Online Architecture' strategy. By strategically inserting Global Average Pooling (GAP) layers at various network depths, we effectively decouple feature recognition from spatial location. Using VGG-16 as a primary case study, we demonstrate that this architectural modification achieves a massive 98% reduction in trainable parameters (from 5.2M to just 82K) and a 90% reduction in total network size (138M to 14M). Despite this drastic pruning, our variants maintain competitive Top-1 accuracy on ImageNet (66.4%) while doubling translational robustness, reducing average relative loss from 0.09 to 0.05. Furthermore, our analysis identifies a fundamental limit to invariance: while GAP resolves macroscopic sensitivity, discrete pooling operations introduce a residual periodic aliasing that prevents perfect pixel-level stability. Finally, we extend these findings to Perceptual Image Quality Assessment (IQA) by integrating our invariant backbones into the LPIPS framework. The resulting metric significantly outperforms the retrained baseline in generalization across the KADID-10k dataset (Spearman 0.89 vs. 0.75) and achieves a near-perfect alignment with human psychophysical response curves on the RAID dataset (Spearman 0.95). These results confirm that enforcing architectural invariance is a far more efficient and biologically plausible path to robustness than traditional data augmentation. Data and code are publicly available. The data and code are publicly available to facilitate validation and further research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。