轻量级网络SpaRTAN通过空间强化令牌聚合,提升视觉识别效率与性能。
SpaRTAN: Spatial Reinforcement Token-based Aggregation Network for Visual Recognition
- 设计可变感受野卷积核,捕捉多阶空间特征。
- 引入波式通道聚合模块,减少通道冗余,增强像素交互。
- 参数仅380万,图像识别准确率77.7%,适合资源受限场景。
卷积神经网络(CNN)在视觉识别任务中的复兴,如ConvNeXt,通过先进训练方法和类似视觉变压器(ViT)的设计原则,已能与基于变压器的架构比肩。然而,CNN和变压器均存在简单性偏差,倾向于选择简单特征而非复杂结构表示。现代CNN常采用类MLP块,类似变压器,但此类块存在显著信息冗余,需高扩展比才能保持竞争力。为此,本文提出SpaRTAN,一种轻量级架构设计,以增强空间和通道信息处理能力。SpaRTAN利用不同感受野的卷积核(由核大小和扩张因子控制),有效捕捉判别性多阶空间特征;同时引入波式通道聚合模块,调节并强化像素间交互,减轻通道冗余。两者结合使网络能高效聚集并动态上下文化判别特征。在ImageNet和COCO上的实验表明,SpaRTAN在保持竞争力的同时实现卓越参数效率:在ImageNet-1k上,仅用380万参数和约1.0 GFLOPs即达77.7%准确率;在COCO上,2150万参数下达到50.0% AP,超越此前基准1.2%。代码公开于[https://github.com/henry-pay/SpaRTAN]。
原文摘要 · Abstract (English)
The resurgence of convolutional neural networks (CNNs) in visual recognition tasks, exemplified by ConvNeXt, has demonstrated their capability to rival transformer-based architectures through advanced training methodologies and ViT-inspired design principles. However, both CNNs and transformers exhibit a simplicity bias, favoring straightforward features over complex structural representations. Furthermore, modern CNNs often integrate MLP-like blocks akin to those in transformers, but these blocks suffer from significant information redundancies, necessitating high expansion ratios to sustain competitive performance. To address these limitations, we propose SpaRTAN, a lightweight architectural design that enhances spatial and channel-wise information processing. SpaRTAN employs kernels with varying receptive fields, controlled by kernel size and dilation factor, to capture discriminative multi-order spatial features effectively. A wave-based channel aggregation module further modulates and reinforces pixel interactions, mitigating channel-wise redundancies. Combining the two modules, the proposed network can efficiently gather and dynamically contextualize discriminative features. Experimental results in ImageNet and COCO demonstrate that SpaRTAN achieves remarkable parameter efficiency while maintaining competitive performance. In particular, on the ImageNet-1k benchmark, SpaRTAN achieves 77. 7% accuracy with only 3.8M parameters and approximately 1.0 GFLOPs, demonstrating its ability to deliver strong performance through an efficient design. On the COCO benchmark, it achieves 50.0% AP, surpassing the previous benchmark by 1.2% with only 21.5M parameters. The code is publicly available at [https://github.com/henry-pay/SpaRTAN].
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。