arXiv:2510.25279cs.CV2025-10NeurIPS被引 1

用扩散模型逐步生成并优化目标域数据,解决无源域适应中的标签不可靠问题。

Diffusion-Driven Progressive Target Manipulation for Source-Free Domain Adaptation

  • 基于伪标签可信度划分目标样本,分治处理以提升信息利用可靠性。
  • 通过扩散模型在保持目标分布的同时,对不可信样本进行语义重构,提升数据质量。
  • 渐进式优化机制显著缩小域差距,最大性能提升达18.6%,适合复杂域偏移场景。

无源域适应(SFDA)面临源域与目标域之间分布差异的挑战,仅依赖预训练源模型和未标注目标数据。现有方法受限于源-目标域差异:非生成类方法在大域偏移下伪标签不可靠,生成类方法则因生成伪源数据时域差距扩大而性能下降。为此,本文提出新型生成式框架——扩散驱动的渐进目标操控(DPTM),利用未标注目标数据作为参考,可靠生成并逐步优化伪目标域。具体地,根据伪标签可信度将目标样本分为可信集与不可信集,充分且可靠地利用其信息;针对不可信集样本,设计语义转换策略将其映射至新类别,同时通过潜在扩散模型维持其目标分布特性;进一步设计渐进式精炼机制,通过迭代优化逐步缩小伪目标域与真实目标域间的域差距。实验表明,DPTM在四个主流SFDA基准数据集上均显著超越现有方法,达到当前最佳性能,尤其在大源-目标差距场景下性能提升最高达18.6%。

原文摘要 · Abstract (English)

Source-free domain adaptation (SFDA) is a challenging task that tackles domain shifts using only a pre-trained source model and unlabeled target data. Existing SFDA methods are restricted by the fundamental limitation of source-target domain discrepancy. Non-generation SFDA methods suffer from unreliable pseudo-labels in challenging scenarios with large domain discrepancies, while generation-based SFDA methods are evidently degraded due to enlarged domain discrepancies in creating pseudo-source data. To address this limitation, we propose a novel generation-based framework named Diffusion-Driven Progressive Target Manipulation (DPTM) that leverages unlabeled target data as references to reliably generate and progressively refine a pseudo-target domain for SFDA. Specifically, we divide the target samples into a trust set and a non-trust set based on the reliability of pseudo-labels to sufficiently and reliably exploit their information. For samples from the non-trust set, we develop a manipulation strategy to semantically transform them into the newly assigned categories, while simultaneously maintaining them in the target distribution via a latent diffusion model. Furthermore, we design a progressive refinement mechanism that progressively reduces the domain discrepancy between the pseudo-target domain and the real target domain via iterative refinement. Experimental results demonstrate that DPTM outperforms existing methods by a large margin and achieves state-of-the-art performance on four prevailing SFDA benchmark datasets with different scales. Remarkably, DPTM can significantly enhance the performance by up to 18.6% in scenarios with large source-target gaps.

无源域适应扩散模型域适应伪标签

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。