arXiv:2501.13307cs.CV2025-01

提出新方法提升可见光与红外图像混合匹配性能。

From Cross-Modal to Mixed-Modal Visible-Infrared Re-Identification

  • 通过解耦模态特有与共享特征,增强跨模态鲁棒性。
  • 在三个数据集上达到当前最优,尤其在混合画廊场景表现突出。
  • 适合实际监控中同时含可见光与红外图像的复杂场景应用。

可见光-红外行人重识别(VI-ReID)旨在跨不同相机模态匹配个体,是现代监控系统的关键任务。现有方法多聚焦于跨模态匹配,但真实场景常包含同时含可见光(V)和红外(I)图像的混合画廊,此时先进方法因显著域偏移和模态内区分度低而性能大幅下降。这是因为同模态图像虽域差距小,却可能对应不同身份。本文引入新的混合模态重识别设定,即画廊同时包含两种模态数据。为解决模态间域偏移及模态内区分力不足问题,提出混合模态擦除与相关(MixER)方法。该方法通过正交分解、模态混淆与身份-模态相关目标,解耦模态特异与共享的身份信息。实验在SYSU-MM01、RegDB和LLMC数据集上验证,仅用单一主干网络即取得领先结果,且在混合画廊应用中展现良好灵活性。

原文摘要 · Abstract (English)

Visible-infrared person re-identification (VI-ReID) aims to match individuals across different camera modalities, a critical task in modern surveillance systems. While current VI-ReID methods focus on cross-modality matching, real-world applications often involve mixed galleries containing both V and I images, where state-of-the-art methods show significant performance limitations due to large domain shifts and low discrimination across mixed modalities. This is because gallery images from the same modality may have lower domain gaps but correspond to different identities. This paper introduces a novel mixed-modal ReID setting, where galleries contain data from both modalities. To address the domain shift among inter-modal and low discrimination capacity in intra-modal matching, we propose the Mixed Modality-Erased and -Related (MixER) method. The MixER learning approach disentangles modality-specific and modality-shared identity information through orthogonal decomposition, modality-confusion, and ID-modality-related objectives. MixER enhances feature robustness across modalities, improving cross-modal and mixed-modal settings performance. Our extensive experiments on the SYSU-MM01, RegDB and LLMC datasets indicate that our approach can provide state-of-the-art results using a single backbone, and showcase the flexibility of our approach in mixed gallery applications.

重识别多模态红外监控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。