用小卷积核组合扩展感受野,同时保持高斯分布,实现高效通用的卷积网络。
UniConvNet: Expanding Effective Receptive Field while Maintaining Asymptotically Gaussian Distribution for ConvNets of Any Scale
- 通过三层感受野聚合器,用小核组合实现大感受野。
- 轻量模型3000万参数达84.2%精度,大模型达88.4%。
- 适合追求高效与可扩展性的视觉任务应用。
具有大有效感受野(ERF)的卷积神经网络仍处于早期阶段,虽展现良好效果,但受限于高参数量与计算量,且破坏了感受野的渐近高斯分布(AGD)。本文提出新范式:与其使用超大感受野,不如通过合理组合较小卷积核(如7×7、9×9、11×11)来扩展感受野并维持其AGD。为此,本文设计了三层感受野聚合器,并引入以感受野为核心的层操作作为基本单元。通过堆叠该模块,可在保持感知场高斯分布的前提下,将感受野扩展至现有大核卷积网络水平。基于此,提出适用于任意规模卷积网络的通用模型UniConvNet。在ImageNet-1K、COCO2017和ADE20K上的大量实验表明,UniConvNet在轻量与大规模模型上均超越当前最优的CNN与ViT,在相当吞吐量下表现优异。令人惊讶的是,UniConvNet-T仅用3000万参数与5.1G FLOPs即达到84.2%的ImageNet top-1准确率;UniConvNet-XL也展现出强大数据与大模型扩展能力,在ImageNet上获得88.4%的准确率。代码与模型已公开于https://github.com/ai-paperwithcode/UniConvNet。
原文摘要 · Abstract (English)
Convolutional neural networks (ConvNets) with large effective receptive field (ERF), still in their early stages, have demonstrated promising effectiveness while constrained by high parameters and FLOPs costs and disrupted asymptotically Gaussian distribution (AGD) of ERF. This paper proposes an alternative paradigm: rather than merely employing extremely large ERF, it is more effective and efficient to expand the ERF while maintaining AGD of ERF by proper combination of smaller kernels, such as $7\times{7}$, $9\times{9}$, $11\times{11}$. This paper introduces a Three-layer Receptive Field Aggregator and designs a Layer Operator as the fundamental operator from the perspective of receptive field. The ERF can be expanded to the level of existing large-kernel ConvNets through the stack of proposed modules while maintaining AGD of ERF. Using these designs, we propose a universal model for ConvNet of any scale, termed UniConvNet. Extensive experiments on ImageNet-1K, COCO2017, and ADE20K demonstrate that UniConvNet outperforms state-of-the-art CNNs and ViTs across various vision recognition tasks for both lightweight and large-scale models with comparable throughput. Surprisingly, UniConvNet-T achieves $84.2\%$ ImageNet top-1 accuracy with $30M$ parameters and $5.1G$ FLOPs. UniConvNet-XL also shows competitive scalability to big data and large models, acquiring $88.4\%$ top-1 accuracy on ImageNet. Code and models are publicly available at https://github.com/ai-paperwithcode/UniConvNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。