arXiv:2511.14203cs.CVcs.AI2025-11

针对船只识别中局部缺失和身份内差异大的难题,提出多尺度相关性感知的Transformer模型。

Multi-Scale Correlation-Aware Transformer for Maritime Vessel Re-Identification

  • 设计全局与局部相关性模块,通过跨图像一致性建模抑制异常样本影响。
  • 在三个基准上达到当前最优性能,显著提升复杂场景下的识别准确率。
  • 适合做海上监控、智能航迹分析等需要高鲁棒性船只识别的应用。

海上船只重识别在推进海事监控与智能态势感知系统中至关重要。然而,现有方法多直接沿用行人重识别算法,难以应对船只图像特有的问题:身份内差异大、局部信息严重缺失,导致同一身份出现异常样本。为此,本文提出多尺度相关性感知变压器网络(MCFormer),显式建模输入集合中多尺度的相关性,以抑制因身份内变化或局部缺失带来的不良影响。MCFormer包含两个新模块:全局相关性模块(GCM)通过跨图像特征聚合构建全局相似性关联矩阵,基于图像间一致性建模全局相关性;局部相关性模块(LCM)通过动态记忆库挖掘并对齐正样本的局部特征,利用上下文相似性提取局部相关性,有效弥补单张图像中缺失或遮挡区域。为增强特征鲁棒性,MCFormer融合多尺度下经相关性建模的全局与局部特征,有效捕捉图像特征间的潜在关系。在三个基准数据集上的实验表明,MCFormer达到当前最优性能。

原文摘要 · Abstract (English)

Maritime vessel re-identification (Re-ID) plays a crucial role in advancing maritime monitoring and intelligent situational awareness systems. However, some existing vessel Re-ID methods are directly adapted from pedestrian-focused algorithms, making them ill-suited for mitigating the unique problems present in vessel images, particularly the greater intra-identity variations and more severe missing of local parts, which lead to the emergence of outlier samples within the same identity. To address these challenges, we propose the Multi-scale Correlation-aware Transformer Network (MCFormer), which explicitly models multi-scale correlations across the entire input set to suppress the adverse effects of outlier samples with intra-identity variations or local missing, incorporating two novel modules, the Global Correlation Module (GCM), and the Local Correlation Module (LCM). Specifically, GCM constructs a global similarity affinity matrix across all input images to model global correlations through feature aggregation based on inter-image consistency, rather than solely learning features from individual images as in most existing approaches. Simultaneously, LCM mines and aligns local features of positive samples with contextual similarity to extract local correlations by maintaining a dynamic memory bank, effectively compensating for missing or occluded regions in individual images. To further enhance feature robustness, MCFormer integrates global and local features that have been respectively correlated across multiple scales, effectively capturing latent relationships among image features. Experiments on three benchmarks demonstrate that MCFormer achieves state-of-the-art performance.

船只识别Transformer多尺度相关性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。