通过不确定性引导图模型,提升多模态目标重识别在噪声下的鲁棒性。
UGG-ReID: Uncertainty-Guided Graph Model for Multi-Modal Object Re-Identification
- 用高斯块图建模局部不确定性,捕捉细粒度特征结构关系。
- 动态路由低不确定性样本至专家网络,抑制噪声干扰,准确率显著提升。
- 适用于复杂场景下跨摄像头多模态目标检索,尤其对遮挡和丢帧敏感。
多模态目标重识别(ReID)旨在利用异构视觉数据源,在不同摄像头间检索特定目标。当前面临两大挑战:(1) 在遮挡、帧丢失等引起的细粒度局部噪声下学习鲁棒特征;(2) 有效融合异构模态以增强多模态表示。为此,本文提出不确定性引导图模型(UGG-ReID),通过估计局部与样本级的偶然不确定性,并显式建模其依赖关系,实现抗噪与模态融合。首先提出高斯块图表示模型,利用不确定性量化细粒度局部线索并捕捉其结构关系,增强模态特异性信息表达,使嵌入更丰富且鲁棒。其次设计不确定性引导的专家混合策略,动态将低不确定性样本路由至对应专家,有效抑制噪声引发的不稳定性,提升鲁棒性;同时引入不确定性引导路由机制强化多模态交互。在五个代表性多模态目标ReID数据集上进行综合评估,涵盖多种光谱模态。实验结果表明,该方法在所有数据集上均表现优异,且在抗噪能力方面显著优于现有方法。代码已开源:https://github.com/wanxixi11/UGG-ReID。
原文摘要 · Abstract (English)
Multi-modal object Re-IDentification (ReID) has gained considerable attention with the goal of retrieving specific targets across cameras using heterogeneous visual data sources. At present, multi-modal object ReID faces two core challenges: (1) learning robust features under fine-grained local noise caused by occlusion, frame loss, and other disruptions; and (2) effectively integrating heterogeneous modalities to enhance multi-modal representation. To address the above challenges, we propose a robust approach named Uncertainty-Guided Graph model for multi-modal object ReID (UGG-ReID). UGG-ReID is designed to mitigate noise interference and facilitate effective multi-modal fusion by estimating both local and sample-level aleatoric uncertainty and explicitly modeling their dependencies. Specifically, we first propose the Gaussian patch-graph representation model that leverages uncertainty to quantify fine-grained local cues and capture their structural relationships. This process boosts the expressiveness of modal-specific information, ensuring that the generated embeddings are both more informative and robust. Subsequently, we design an uncertainty-guided mixture of experts strategy that dynamically routes samples to experts exhibiting low uncertainty. This strategy effectively suppresses noise-induced instability, leading to enhanced robustness. Meanwhile, we design an uncertainty-guided routing to strengthen the multi-modal interaction, improving the performance. UGG-ReID is comprehensively evaluated on five representative multi-modal object ReID datasets, encompassing diverse spectral modalities. Experimental results show that the proposed method achieves excellent performance on all datasets and is significantly better than current methods in terms of noise immunity. Our code is available at https://github.com/wanxixi11/UGG-ReID.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。