arXiv:2604.10210cs.CVcs.AI2026-04被引 1

提出A3-FPN网络,提升密集视觉预测中小目标识别能力

A3-FPN: Asymptotic Content-Aware Pyramid Attention Network for Dense Visual Prediction

  • 设计渐近解耦结构与内容感知注意力,增强多尺度特征表达
  • 在MS COCO上达49.6掩码AP,Cityscapes上达85.6 mIoU
  • 可无缝融合于CNN与Transformer模型,适合小物体检测任务

学习多尺度表示是应对密集预测任务中目标尺度变化的通用策略。尽管现有特征金字塔网络显著推进了视觉识别,但固有设计缺陷限制了其捕捉判别性特征和识别小物体的能力。本文提出渐近内容感知金字塔注意力网络(A3-FPN),通过渐近解耦框架与内容感知注意力模块增强多尺度特征表示。具体而言,A3-FPN采用横向扩展的列网络,实现渐近全局特征交互,并将每一层从所有层级表示中解耦。在特征融合中,从相邻层级提取补充内容,生成位置级偏移与权重以进行上下文感知重采样,并学习深层上下文重加权以提升类内相似性。在特征重组阶段,进一步强化同尺度判别特征学习,并基于特征图的信息含量与空间变化重组冗余特征。在MS COCO、VisDrone2019-DET和Cityscapes上的大量实验表明,A3-FPN可轻松集成至先进的CNN与基于Transformer的架构中,带来显著性能提升。特别地,搭配OneFormer与Swin-L主干网络时,在MS COCO上达到49.6掩码平均精度,在Cityscapes上达到85.6平均交并比。代码已开源。

原文摘要 · Abstract (English)

Learning multi-scale representations is the common strategy to tackle object scale variation in dense prediction tasks. Although existing feature pyramid networks have greatly advanced visual recognition, inherent design defects inhibit them from capturing discriminative features and recognizing small objects. In this work, we propose Asymptotic Content-Aware Pyramid Attention Network (A3-FPN), to augment multi-scale feature representation via the asymptotically disentangled framework and content-aware attention modules. Specifically, A3-FPN employs a horizontally-spread column network that enables asymptotically global feature interaction and disentangles each level from all hierarchical representations. In feature fusion, it collects supplementary content from the adjacent level to generate position-wise offsets and weights for context-aware resampling, and learns deep context reweights to improve intra-category similarity. In feature reassembly, it further strengthens intra-scale discriminative feature learning and reassembles redundant features based on information content and spatial variation of feature maps. Extensive experiments on MS COCO, VisDrone2019-DET and Cityscapes demonstrate that A3-FPN can be easily integrated into state-of-the-art CNN and Transformer-based architectures, yielding remarkable performance gains. Notably, when paired with OneFormer and Swin-L backbone, A3-FPN achieves 49.6 mask AP on MS COCO and 85.6 mIoU on Cityscapes. Codes are available at https://github.com/mason-ching/A3-FPN.

特征金字塔小目标检测注意力机制密集预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。