arXiv:2601.02924cs.CVcs.AI2026-01

针对多模态车辆重识别中的模态质量差异问题,提出解耦融合新方法。

DCG ReID: Disentangling Collaboration and Guidance Fusion Representations for Multi-modal Vehicle Re-Identification

  • 按模态质量平衡与否设计双路径融合策略,避免冲突
  • 在三个数据集上达到最高精度,显著提升跨模态匹配性能
  • 适合需要处理不同质量图像的智能交通系统应用

多模态车辆重识别旨在融合可见光(RGB)、近红外(NIR)和热红外(TIR)模态的互补信息以检索同一车辆。其挑战源于模态间固有差异导致的模态质量分布不确定性,使质量均衡与不均衡数据面临截然不同的融合需求。现有方法采用统一融合模型,忽略两类数据的不同需求,难以化解类内一致性与模态异质性之间的冲突。为此,本文提出解耦协作与引导融合表征的多模态车辆重识别方法(DCG-ReID)。首先设计动态置信度解耦加权机制(DCDW),通过模态间交互生成的置信度动态调整三模态贡献,构建解耦融合框架;在此基础上,针对质量均衡数据设计协作融合模块(CFM),挖掘成对共识特征以增强类内一致性;针对质量不均衡数据设计引导融合模块(GFM),差异化增强主导模态优势,引导辅助模态提取互补判别信息,缓解模态间偏差,提升联合决策性能。在三个多模态重识别基准(WMVeID863、MSVR310、RGBNT100)上的大量实验验证了方法的有效性。代码将在录用后公开。

原文摘要 · Abstract (English)

Multi-modal vehicle Re-Identification (ReID) aims to leverage complementary information from RGB, Near Infrared (NIR), and Thermal Infrared (TIR) modalities to retrieve the same vehicle. The challenges of multi-modal vehicle ReID arise from the uncertainty of modality quality distribution induced by inherent discrepancies across modalities, resulting in distinct conflicting fusion requirements for data with balanced and unbalanced quality distributions. Existing methods handle all multi-modal data within a single fusion model, overlooking the different needs of the two data types and making it difficult to decouple the conflict between intra-class consistency and inter-modal heterogeneity. To this end, we propose Disentangle Collaboration and Guidance Fusion Representations for Multi-modal Vehicle ReID (DCG-ReID). Specifically, to disentangle heterogeneous quality-distributed modal data without mutual interference, we first design the Dynamic Confidence-based Disentangling Weighting (DCDW) mechanism: dynamically reweighting three-modal contributions via interaction-derived modal confidence to build a disentangled fusion framework. Building on DCDW, we develop two scenario-specific fusion strategies: (1) for balanced quality distributions, Collaboration Fusion Module (CFM) mines pairwise consensus features to capture shared discriminative information and boost intra-class consistency; (2) for unbalanced distributions, Guidance Fusion Module (GFM) implements differential amplification of modal discriminative disparities to reinforce dominant modality advantages, guide auxiliary modalities to mine complementary discriminative info, and mitigate inter-modal divergence to boost multi-modal joint decision performance. Extensive experiments on three multi-modal ReID benchmarks (WMVeID863, MSVR310, RGBNT100) validate the effectiveness of our method. Code will be released upon acceptance.

多模态车辆重识别融合策略解耦学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。