基于Transformer的鲁棒人群计数模型,提升复杂场景下计数精度。
RCCFormer: A Robust Crowd Counting Network Based on Transformer
- 采用多层级特征融合与注意力机制,增强细节与上下文感知。
- 在ShanghaiTech、NWPU-Crowd等四个数据集上达到最优性能。
- 适合需要高精度人群计数的公共安全与监控场景。
人群计数是计算机视觉中的关键任务,对人群分析与公共安全管理至关重要。然而,尺度变化和复杂背景严重影响计数精度。为此,本文提出一种基于Transformer的鲁棒人群计数网络RCCFormer,专为背景抑制与尺度感知设计。该方法引入多层级特征融合模块(MFFM),精细整合骨干网络不同阶段提取的特征,建立强基线以捕捉复杂全面的特征表示。进一步,提出的细节嵌入注意力块(DEAB)通过全局自注意力与局部注意力结合,可学习地融合信息,增强对前景区域的关注并有效抑制背景噪声。此外,设计自适应尺度感知模块(ASAM),以新型输入依赖可变形卷积(IDConv)为核心,动态适应头部目标形状与尺度变化,显著提升模型应对大规模尺度差异的能力。在ShanghaiTech Part_A、Part_B,NWPU-Crowd及QNRF数据集上的实验验证了该方法的有效性,结果表明RCCFormer在所有数据集上均取得优异表现,达到当前最优水平。
原文摘要 · Abstract (English)
Crowd counting, which is a key computer vision task, has emerged as a fundamental technology in crowd analysis and public safety management. However, challenges such as scale variations and complex backgrounds significantly impact the accuracy of crowd counting. To mitigate these issues, this paper proposes a robust Transformer-based crowd counting network, termed RCCFormer, specifically designed for background suppression and scale awareness. The proposed method incorporates a Multi-level Feature Fusion Module (MFFM), which meticulously integrates features extracted at diverse stages of the backbone architecture. It establishes a strong baseline capable of capturing intricate and comprehensive feature representations, surpassing traditional baselines. Furthermore, the introduced Detail-Embedded Attention Block (DEAB) captures contextual information and local details through global self-attention and local attention along with a learnable manner for efficient fusion. This enhances the model's ability to focus on foreground regions while effectively mitigating background noise interference. Additionally, we develop an Adaptive Scale-Aware Module (ASAM), with our novel Input-dependent Deformable Convolution (IDConv) as its fundamental building block. This module dynamically adapts to changes in head target shapes and scales, significantly improving the network's capability to accommodate large-scale variations. The effectiveness of the proposed method is validated on the ShanghaiTech Part_A and Part_B, NWPU-Crowd, and QNRF datasets. The results demonstrate that our RCCFormer achieves excellent performance across all four datasets, showcasing state-of-the-art outcomes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。