arXiv:2504.20498cs.CV2025-04被引 4

用动态风格适配器提升检测模型在未知场景下的泛化能力

Style-Adaptive Detection Transformer for Single-Source Domain Generalized Object Detection

  • 引入在线域风格适配器,通过记忆库自组织生成风格原型
  • 在五种天气场景下显著优于现有方法,检测准确率与泛化能力双提升
  • 适合需要跨域鲁棒检测的自动驾驶、遥感等实际应用

单源域泛化(SDG)目标是仅使用源域数据训练检测器,使其在未见目标域上表现良好。现有方法多基于CNN,依赖数据增强与特征对齐,但增强效果受限于合成分布与真实未见域的接近程度,难以保证跨场景泛化。尽管DETR因全局上下文建模在域自适应中表现优异,其在SDG中的潜力尚未充分挖掘。为此,本文提出风格自适应检测变压器(SA-DETR),一种面向SDG的DETR架构。SA-DETR设计在线域风格适配器,通过动态记忆库将未见域风格投影至源域,该库可自组织为多样风格原型,并在测试时持续更新,实现有效风格校正。此外,设计对象感知对比学习模块,通过空间与语义维度的门控掩码约束对比过程,促进实例级跨域对比,增强域不变特征提取。在五个不同天气场景下的大量实验表明,SA-DETR在检测精度和域泛化能力上均持续超越现有方法。

原文摘要 · Abstract (English)

Single-source domain generalization (SDG) in object detection aims to develop a detector using only source domain data that generalizes well to unseen target domains. Existing methods are primarily CNN-based and improve robustness through data augmentation combined with feature alignment. However, these methods are limited, as augmentation is only effective when the synthetic distribution approximates that of unseen domains, thus failing to ensure generalization across diverse scenarios. While DEtection TRansformer (DETR) has shown strong generalization in domain adaptation due to global context modeling, its potential for SDG remains underexplored. To this end, we propose Style-Adaptive DEtection TRansformer (SA-DETR), a DETR-based detector tailored for SDG. SA-DETR introduces an online domain style adapter that projects the style representation of unseen domains into the source domain via a dynamic memory bank. This bank self-organizes into diverse style prototypes and is continuously updated under a test-time adaptation framework, enabling effective style rectification. Additionally, we design an object-aware contrastive learning module to promote extraction of domain-invariant features. By applying gating masks that constrain contrastive learning in both spatial and semantic dimensions, this module facilitates instance-level cross-domain contrast and enhances generalization. Extensive experiments across five distinct weather scenarios demonstrate that SA-DETR consistently outperforms existing methods in both detection accuracy and domain generalization capability.

目标检测域泛化Transformer风格适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。