arXiv:2412.12830cs.CV2024-12中稿 · AAAI被引 9

针对目标域检测中特征对齐不均衡问题,提出差异化的注意力机制提升模型泛化能力。

Differential Alignment for Domain Adaptive Object Detection

  • 根据师生模型检测差异动态加权实例,突出重要区域
  • 通过不确定性引导聚焦前景区域,增强关键信息对齐
  • 在多个主流数据集上超越现有最优方法,适合跨域检测场景

领域自适应目标检测(DAOD)旨在将标注源域训练的检测器泛化到无标注目标域,其核心是源-目标特征对齐。现有方法通常采用对抗学习整体对齐源与目标域分布,却未考虑不同区域(如不同情境下的实例、前景与背景)在对齐中的重要性差异。为此,本文提出一种差异特征对齐策略:设计预测差异反馈实例对齐模块(PDFA),基于教师-学生检测差异自适应为高差异实例分配更高权重,有效处理领域特异性信息;同时提出基于不确定性的前景导向图像对齐模块(UFOA),显式引导模型关注感兴趣区域。在多个广泛使用的DAOD数据集上进行大量实验及消融研究,验证了所提方法的有效性,显著优于其他SOTA方法。代码已开源:https://github.com/EstrellaXyu/Differential-Alignment-for-DAOD。

原文摘要 · Abstract (English)

Domain adaptive object detection (DAOD) aims to generalize an object detector trained on labeled source-domain data to a target domain without annotations, the core principle of which is \emph{source-target feature alignment}. Typically, existing approaches employ adversarial learning to align the distributions of the source and target domains as a whole, barely considering the varying significance of distinct regions, say instances under different circumstances and foreground \emph{vs} background areas, during feature alignment. To overcome the shortcoming, we investigates a differential feature alignment strategy. Specifically, a prediction-discrepancy feedback instance alignment module (dubbed PDFA) is designed to adaptively assign higher weights to instances of higher teacher-student detection discrepancy, effectively handling heavier domain-specific information. Additionally, an uncertainty-based foreground-oriented image alignment module (UFOA) is proposed to explicitly guide the model to focus more on regions of interest. Extensive experiments on widely-used DAOD datasets together with ablation studies are conducted to demonstrate the efficacy of our proposed method and reveal its superiority over other SOTA alternatives. Our code is available at https://github.com/EstrellaXyu/Differential-Alignment-for-DAOD.

目标检测域自适应特征对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。