arXiv:2502.01303cs.CVcs.AI2025-02被引 8

通过分通道机制减少计算量,提升模型精度与速度

Partial Channel Network: Compute Fewer, Perform Better

  • 将特征图通道分块,分别处理以降低计算开销
  • 在ImageNet上实现更高准确率和更快推理速度
  • 适合追求高效部署的计算机视觉研究者

设计一种既能保持低参数量和算力消耗,又不牺牲准确率和吞吐量的网络模块仍具挑战。为解决此问题并利用特征图通道间的冗余,我们提出部分通道机制(PCM)。通过分割操作,将特征图通道划分为不同部分,每部分对应不同操作,如卷积、注意力、池化或恒等映射。基于此,提出新型部分注意力卷积(PATConv),可高效融合卷积与视觉注意力,且能完全替代常规卷积和注意力模块,同时减少模型参数和FLOPs。PATConv衍生出三种新模块:部分通道注意力块(PAT_ch)、部分空间注意力块(PAT_sp)和部分自注意力块(PAT_sf)。此外,提出动态部分卷积(DPConv),可自适应学习各层分割通道比例,实现更优权衡。基于PATConv与DPConv,构建新型混合网络家族PartialNet,在ImageNet-1K分类任务上表现优于多个SOTA模型,并在COCO目标检测与分割任务中均表现出色。

原文摘要 · Abstract (English)

Designing a module or mechanism that enables a network to maintain low parameters and FLOPs without sacrificing accuracy and throughput remains a challenge. To address this challenge and exploit the redundancy within feature map channels, we propose a new solution: partial channel mechanism (PCM). Specifically, through the split operation, the feature map channels are divided into different parts, with each part corresponding to different operations, such as convolution, attention, pooling, and identity mapping. Based on this assumption, we introduce a novel partial attention convolution (PATConv) that can efficiently combine convolution with visual attention. Our exploration indicates that the PATConv can completely replace both the regular convolution and the regular visual attention while reducing model parameters and FLOPs. Moreover, PATConv can derive three new types of blocks: Partial Channel-Attention block (PAT_ch), Partial Spatial-Attention block (PAT_sp), and Partial Self-Attention block (PAT_sf). In addition, we propose a novel dynamic partial convolution (DPConv) that can adaptively learn the proportion of split channels in different layers to achieve better trade-offs. Building on PATConv and DPConv, we propose a new hybrid network family, named PartialNet, which achieves superior top-1 accuracy and inference speed compared to some SOTA models on ImageNet-1K classification and excels in both detection and segmentation on the COCO dataset. Our code is available at https://github.com/haiduo/PartialNet.

通道机制轻量化网络注意力融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。