arXiv:2410.08456cs.CV2024-10被引 5

提出统一框架提升跨域行人重识别性能,无需目标域标签

A Unified Deep Semantic Expansion Framework for Domain-Generalized Person Re-identification

  • 融合隐式与显式语义特征扩展,统一建模新方法
  • 在多个基准上达到新SOTA,避免过早饱和问题
  • 适用于跨域图像检索,对实际部署场景更友好

监督式行人重识别(Person ReID)在单一摄像头网络内表现优异,但在不同摄像头系统间应用时性能显著下降。尽管近年提出多种无标签目标域数据的领域自适应方法,但其仍需目标域未标注数据参与训练,难以满足真实场景需求。本文聚焦更具实用价值的领域泛化行人重识别(DG-ReID)问题:仅基于一个或多个源域,学习可泛化至未见目标域的模型。现有方法如隐式深度语义特征扩展(DEX)虽有效,但因损失函数局限,在大型评估基准上易过早饱和,未能发挥全部潜力。为此,本文提出统一深度语义扩展(Unified Deep Semantic Expansion)框架,首次将隐式与显式特征扩展整合于同一架构中,缓解过早过拟合问题,在所有DG-ReID基准上均取得新SOTA。进一步地,该方法在更广泛的图像检索任务中也大幅超越当前SOTA。

原文摘要 · Abstract (English)

Supervised Person Re-identification (Person ReID) methods have achieved excellent performance when training and testing within one camera network. However, they usually suffer from considerable performance degradation when applied to different camera systems. In recent years, many Domain Adaptation Person ReID methods have been proposed, achieving impressive performance without requiring labeled data from the target domain. However, these approaches still need the unlabeled data of the target domain during the training process, making them impractical in many real-world scenarios. Our work focuses on the more practical Domain Generalized Person Re-identification (DG-ReID) problem. Given one or more source domains, it aims to learn a generalized model that can be applied to unseen target domains. One promising research direction in DG-ReID is the use of implicit deep semantic feature expansion, and our previous method, Domain Embedding Expansion (DEX), is one such example that achieves powerful results in DG-ReID. However, in this work we show that DEX and other similar implicit deep semantic feature expansion methods, due to limitations in their proposed loss function, fail to reach their full potential on large evaluation benchmarks as they have a tendency to saturate too early. Leveraging on this analysis, we propose Unified Deep Semantic Expansion, our novel framework that unifies implicit and explicit semantic feature expansion techniques in a single framework to mitigate this early over-fitting and achieve a new state-of-the-art (SOTA) in all DG-ReID benchmarks. Further, we apply our method on more general image retrieval tasks, also surpassing the current SOTA in all of these benchmarks by wide margins.

行人重识别领域泛化特征扩展图像检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。