arXiv:2506.04211cs.CV2025-06被引 16

用扩散模型生成伪标签,提升跨域目标检测性能

Diffusion Domain Teacher: Diffusion Guided Domain Adaptive Object Detector

  • 冻结扩散模型生成目标域伪标签,指导学生模型学习
  • 在6个数据集上平均提升21.2% mAP,超SOTA 5.7% mAP
  • 适用于复杂模型,通用性强,适合跨域检测场景

目标检测器常因训练数据(源域)与真实世界数据(目标域)之间的巨大领域差距导致性能下降。基于扩散的生成模型展现出生成高质量、多样化图像的能力,表明其在提取跨域特征方面具有潜力。本文提出一种名为扩散域教师(Diffusion Domain Teacher, DDT)的方法:先在源域上使用权重冻结的扩散模型训练检测器,再将其作为教师模型,在未标注的目标域上生成伪标签,用于指导学生模型在目标域上的监督学习。该方法无需改变推理速度,显著提升跨域检测性能。在三个常见跨域检测基准(Cross-Camera、Syn2Real、Real2Artistic)的6个数据集上,相比基线平均提升21.2% mAP,超越当前SOTA方法平均5.7% mAP。大量实验表明,该方法在更强大复杂的模型中仍具持续提升能力,验证了其广泛适用性与有效性。代码已开源。

原文摘要 · Abstract (English)

Object detectors often suffer a decrease in performance due to the large domain gap between the training data (source domain) and real-world data (target domain). Diffusion-based generative models have shown remarkable abilities in generating high-quality and diverse images, suggesting their potential for extracting valuable feature from various domains. To effectively leverage the cross-domain feature representation of diffusion models, in this paper, we train a detector with frozen-weight diffusion model on the source domain, then employ it as a teacher model to generate pseudo labels on the unlabeled target domain, which are used to guide the supervised learning of the student model on the target domain. We refer to this approach as Diffusion Domain Teacher (DDT). By employing this straightforward yet potent framework, we significantly improve cross-domain object detection performance without compromising the inference speed. Our method achieves an average mAP improvement of 21.2% compared to the baseline on 6 datasets from three common cross-domain detection benchmarks (Cross-Camera, Syn2Real, Real2Artistic}, surpassing the current state-of-the-art (SOTA) methods by an average of 5.7% mAP. Furthermore, extensive experiments demonstrate that our method consistently brings improvements even in more powerful and complex models, highlighting broadly applicable and effective domain adaptation capability of our DDT. The code is available at https://github.com/heboyong/Diffusion-Domain-Teacher.

目标检测域自适应扩散模型伪标签

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。