arXiv:2412.11443cs.CVcs.AI2024-12AAAI被引 10

提出双概率对齐框架,提升跨域目标检测在开放、部分、封闭场景下的性能。

Universal Domain Adaptive Object Detection via Dual Probabilistic Alignment

  • 用高斯分布建模领域概率,实现多层级特征的异质性对齐。
  • 在多个数据集上优于现有方法,开放/部分/封闭场景均提升显著。
  • 适合需要处理复杂领域迁移的目标检测任务研究者。

领域自适应目标检测(DAOD)在封闭集假设下将标注源域知识迁移到未标注目标域。通用领域自适应目标检测(UniDAOD)将其扩展至开放集、部分集和封闭集场景。本文揭示两个关键问题:全局特征中领域私有类别对齐至关重要,且不同层级特征存在领域概率异质性。为此,提出新型双概率对齐(DPA)框架,将领域概率建模为高斯分布,支持异质领域分布采样与度量。DPA包含三个模块:全局级领域私有对齐(GDPA)、实例级领域共享对齐(IDSA)和私有类别约束(PCC)。GDPA通过全局采样挖掘领域私有类别样本,并利用累积分布函数计算对齐权重,解决全局私有类别对齐问题;IDSA通过实例级采样挖掘领域共享类别样本,基于高斯分布计算对齐权重,应对特征异质性;PCC在特征空间与概率空间间聚合领域私有类别中心,缓解负迁移。大量实验表明,DPA在多种数据集与场景(开放、部分、封闭集)下均超越当前最优的UniDAOD与DAOD方法。代码已开源。

原文摘要 · Abstract (English)

Domain Adaptive Object Detection (DAOD) transfers knowledge from a labeled source domain to an unannotated target domain under closed-set assumption. Universal DAOD (UniDAOD) extends DAOD to handle open-set, partial-set, and closed-set domain adaptation. In this paper, we first unveil two issues: domain-private category alignment is crucial for global-level features, and the domain probability heterogeneity of features across different levels. To address these issues, we propose a novel Dual Probabilistic Alignment (DPA) framework to model domain probability as Gaussian distribution, enabling the heterogeneity domain distribution sampling and measurement. The DPA consists of three tailored modules: the Global-level Domain Private Alignment (GDPA), the Instance-level Domain Shared Alignment (IDSA), and the Private Class Constraint (PCC). GDPA utilizes the global-level sampling to mine domain-private category samples and calculate alignment weight through a cumulative distribution function to address the global-level private category alignment. IDSA utilizes instance-level sampling to mine domain-shared category samples and calculates alignment weight through Gaussian distribution to conduct the domain-shared category domain alignment to address the feature heterogeneity. The PCC aggregates domain-private category centroids between feature and probability spaces to mitigate negative transfer. Extensive experiments demonstrate that our DPA outperforms state-of-the-art UniDAOD and DAOD methods across various datasets and scenarios, including open, partial, and closed sets. Codes are available at \url{https://github.com/zyfone/DPA}.

目标检测领域自适应迁移学习概率建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。