用单模标签实现可见光红外行人重识别,不依赖成对标注
Weakly Supervised Visible-Infrared Person Re-Identification via Heterogeneous Expert Collaborative Consistency Learning
- 构建异构专家协作框架,利用单模标签生成跨模态对应关系
- 在两个挑战数据集上超越现有弱监督方法,准确率提升显著
- 适合缺乏跨模态标注的现实场景,如安防监控系统部署
为降低可见光-红外行人重识别模型对标注跨模态样本的依赖,本文提出一种仅使用单模样本身份标签的弱监督跨模态行人重识别方法,解决跨模态身份标签不可用的场景。为缓解缺失跨模态标签对模型性能的影响,我们设计了一种异构专家协作一致性学习框架,旨在弱监督下建立鲁棒的跨模态身份对应关系。该框架利用各模态的标注数据独立训练专用分类专家;通过这些分类专家作为异构预测器,预测另一模态样本的身份以建立跨模态关联。为提升预测精度,设计了跨模态关系融合机制,有效整合不同专家的预测结果。在跨模态身份对应关系的隐式监督下,促进专家间的协同与一致性学习,显著增强模型提取模态不变特征的能力,提升跨模态身份识别效果。在两个具有挑战性的数据集上的实验验证了所提方法的有效性。
原文摘要 · Abstract (English)
To reduce the reliance of visible-infrared person re-identification (ReID) models on labeled cross-modal samples, this paper explores a weakly supervised cross-modal person ReID method that uses only single-modal sample identity labels, addressing scenarios where cross-modal identity labels are unavailable. To mitigate the impact of missing cross-modal labels on model performance, we propose a heterogeneous expert collaborative consistency learning framework, designed to establish robust cross-modal identity correspondences in a weakly supervised manner. This framework leverages labeled data from each modality to independently train dedicated classification experts. To associate cross-modal samples, these classification experts act as heterogeneous predictors, predicting the identities of samples from the other modality. To improve prediction accuracy, we design a cross-modal relationship fusion mechanism that effectively integrates predictions from different experts. Under the implicit supervision provided by cross-modal identity correspondences, collaborative and consistent learning among the experts is encouraged, significantly enhancing the model's ability to extract modality-invariant features and improve cross-modal identity recognition. Experimental results on two challenging datasets validate the effectiveness of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。