arXiv:2412.17239cs.CVcs.IR2024-12中稿 · Trans被引 16

融合卷积与注意力机制,提升跨摄像头行人识别精度

Unity is Strength: Unifying Convolutional and Transformeral Features for Better Person Re-Identification

  • 双分支并行提取卷积与变换特征,互补增强表示能力
  • 在三个公开数据集上超越多数现有方法,最高提升2.1%
  • 适合需要高精度行人检索的智能交通系统应用

行人重识别(ReID)旨在跨非重叠摄像头检索特定人员,对智能交通系统至关重要。卷积神经网络(CNN)擅长提取局部特征,而变换器(Transformer)更擅长捕捉全局语义。为此,本文提出FusionReID框架,统一两者优势。首先通过双分支特征提取(DFE)从单张图像中分别提取CNN和Transformer特征;再设计双注意力互融模块(DMF),包含局部精修单元(LRU)与异构传输模块(HTM)。LRU使用深度可分离卷积对齐通道与空间维度;HTM含共享编码单元(SEU)和两个互融单元(MFU),通过堆叠实现特征反复利用,生成更具区分性的表征。在三个公开ReID基准测试中,本方法性能优于多数先进方法,最高提升达2.1%。代码已开源。

原文摘要 · Abstract (English)

Person Re-identification (ReID) aims to retrieve the specific person across non-overlapping cameras, which greatly helps intelligent transportation systems. As we all know, Convolutional Neural Networks (CNNs) and Transformers have the unique strengths to extract local and global features, respectively. Considering this fact, we focus on the mutual fusion between them to learn more comprehensive representations for persons. In particular, we utilize the complementary integration of deep features from different model structures. We propose a novel fusion framework called FusionReID to unify the strengths of CNNs and Transformers for image-based person ReID. More specifically, we first deploy a Dual-branch Feature Extraction (DFE) to extract features through CNNs and Transformers from a single image. Moreover, we design a novel Dual-attention Mutual Fusion (DMF) to achieve sufficient feature fusions. The DMF comprises Local Refinement Units (LRU) and Heterogenous Transmission Modules (HTM). LRU utilizes depth-separable convolutions to align deep features in channel dimensions and spatial sizes. HTM consists of a Shared Encoding Unit (SEU) and two Mutual Fusion Units (MFU). Through the continuous stacking of HTM, deep features after LRU are repeatedly utilized to generate more discriminative features. Extensive experiments on three public ReID benchmarks demonstrate that our method can attain superior performances than most state-of-the-arts. The source code is available at https://github.com/924973292/FusionReID.

行人重识别特征融合双分支网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。