arXiv:2504.06607cs.CV2025-04被引 2

通过匹配视觉相似样本对,提升跨域目标检测鲁棒性

Visually Similar Pair Alignment for Robust Cross-Domain Object Detection

  • 基于记忆库检索源域中视觉相似的特征进行对齐
  • 在Foggy Cityscapes和Sim10k上分别达53.1和62.3 mAP
  • 适合处理复杂视觉变化与域间差异并存场景

训练数据(源域)与真实环境(目标域)之间的域差距常导致目标检测模型性能下降。现有方法多通过跨域特征对齐来缓解此问题,但往往忽略对齐样本间的视觉差异(如颜色、方向),导致模型难以同时应对域特定偏移(如雾霾)与视觉变化。本文首次基于自建数据集证明:对齐视觉相似样本对可显著提升域适应效果。为此,提出一种新型记忆机制,存储源域前景与背景区域的预计算特征,并在训练中周期性更新。通过检索与目标域前景/背景特征视觉相似的源域特征进行对齐,模型能有效应对域间差异,同时降低视觉变化影响。在多种域偏移场景下的实验验证了该方法的有效性,在Foggy Cityscapes上达到53.1 mAP,Sim10k上达62.3 mAP,分别优于先前最优方法1.2和4.1 mAP。

原文摘要 · Abstract (English)

Domain gaps between training data (source) and real-world environments (target) often degrade the performance of object detection models. Most existing methods aim to bridge this gap by aligning features across source and target domains but often fail to account for visual differences, such as color or orientation, in alignment pairs. This limitation leads to less effective domain adaptation, as the model struggles to manage both domain-specific shifts (e.g., fog) and visual variations simultaneously. In this work, we demonstrate for the first time, using a custom-built dataset, that aligning visually similar pairs significantly improves domain adaptation. Based on this insight, we propose a novel memory-based system to enhance domain alignment. This system stores precomputed features of foreground objects and background areas from the source domain, which are periodically updated during training. By retrieving visually similar source features for alignment with target foreground and background features, the model effectively addresses domain-specific differences while reducing the impact of visual variations. Extensive experiments across diverse domain shift scenarios validate our method's effectiveness, achieving 53.1 mAP on Foggy Cityscapes and 62.3 on Sim10k, surpassing prior state-of-the-art methods by 1.2 and 4.1 mAP, respectively.

跨域检测特征对齐记忆网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。