arXiv:2506.23202cs.CV2025-06

通过高频增强与多波混合,提升行人检索的精度与效率

Transformer-Based Person Search with High-Frequency Augmentation and Multi-Wave Mixing

  • 用高频增强输入并融合多尺度哈尔小波替代自注意力
  • 在CUHK-SYSU和PRW上达到当前最佳性能
  • 适合关注行人检索模型效率与细节特征捕捉的研究者

行人检索旨在从场景图像中定位目标行人。近年来,基于Transformer的模型虽取得进展,但仍面临三大挑战:1)自注意力机制会抑制特征中的高频成分,严重影响性能;2)Transformer计算成本较高。为此,我们提出一种新型高频率增强与多波混合(HAMW)方法。HAMW通过三阶段框架逐步优化检测与重识别性能。模型通过学习包含额外高频成分的增强输入,提升对高频特征的感知能力。同时,用基于多层级哈尔小波融合的策略替代Transformer中的自注意力层,以捕获多尺度特征。该设计不仅降低计算复杂度,还缓解高频特征抑制,增强多尺度信息利用能力。大量实验表明,HAMW在CUHK-SYSU和PRW数据集上均达到当前最优性能。

原文摘要 · Abstract (English)

The person search task aims to locate a target person within a set of scene images. In recent years, transformer-based models in this field have made some progress. However, they still face three primary challenges: 1) the self-attention mechanism tends to suppress high-frequency components in the features, which severely impacts model performance; 2) the computational cost of transformers is relatively high. To address these issues, we propose a novel High-frequency Augmentation and Multi-Wave mixing (HAMW) method for person search. HAMW is designed to enhance the discriminative feature extraction capabilities of transformers while reducing computational overhead and improving efficiency. Specifically, we develop a three-stage framework that progressively optimizes both detection and re-identification performance. Our model enhances the perception of high-frequency features by learning from augmented inputs containing additional high-frequency components. Furthermore, we replace the self-attention layers in the transformer with a strategy based on multi-level Haar wavelet fusion to capture multi-scale features. This not only lowers the computational complexity but also alleviates the suppression of high-frequency features and enhances the ability to exploit multi-scale information. Extensive experiments demonstrate that HAMW achieves state-of-the-art performance on both the CUHK-SYSU and PRW datasets.

行人检索Transformer特征增强多尺度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。