用噪声优化的生成模型,提升无监督域适应中伪标签质量。
Noise Optimized Conditional Diffusion for Domain Adaptation
- 将条件扩散模型与域适应任务耦合,统一优化分类与生成。
- 在5个数据集、29个任务上超越31种先进方法,性能显著提升。
- 提出类别感知噪声优化,生成更清晰的高置信伪标签,适合图像迁移场景。
伪标签是无监督域适应(UDA)的核心,但高置信伪标签目标域样本(hcpl-tds)稀缺常导致跨域统计对齐不准,引发域适应失败。为此,我们提出噪声优化的条件扩散域适应方法(NOCDDA),将条件扩散模型的生成能力与域适应决策需求融合,实现任务耦合优化,提升适配效率。为增强跨域一致性,我们修改域适应分类器,在统一优化框架下与条件扩散分类器对齐,支持在噪声变化的跨域样本上进行前向训练。此外,我们指出扩散模型中传统的\( \mathcal{N}(\mathbf{0}, \mathbf{I}) \)初始化常生成类别混淆的hcpl-tds,损害判别性。为此,引入类别感知噪声优化策略,精炼反向生成类特定hcpl-tds的采样区域,有效提升跨域对齐效果。在5个基准数据集和29个域适应任务上的广泛实验表明,NOCDDA显著优于31种先进方法,验证了其鲁棒性与有效性。
原文摘要 · Abstract (English)
Pseudo-labeling is a cornerstone of Unsupervised Domain Adaptation (UDA), yet the scarcity of High-Confidence Pseudo-Labeled Target Domain Samples (\textbf{hcpl-tds}) often leads to inaccurate cross-domain statistical alignment, causing DA failures. To address this challenge, we propose \textbf{N}oise \textbf{O}ptimized \textbf{C}onditional \textbf{D}iffusion for \textbf{D}omain \textbf{A}daptation (\textbf{NOCDDA}), which seamlessly integrates the generative capabilities of conditional diffusion models with the decision-making requirements of DA to achieve task-coupled optimization for efficient adaptation. For robust cross-domain consistency, we modify the DA classifier to align with the conditional diffusion classifier within a unified optimization framework, enabling forward training on noise-varying cross-domain samples. Furthermore, we argue that the conventional \( \mathcal{N}(\mathbf{0}, \mathbf{I}) \) initialization in diffusion models often generates class-confused hcpl-tds, compromising discriminative DA. To resolve this, we introduce a class-aware noise optimization strategy that refines sampling regions for reverse class-specific hcpl-tds generation, effectively enhancing cross-domain alignment. Extensive experiments across 5 benchmark datasets and 29 DA tasks demonstrate significant performance gains of \textbf{NOCDDA} over 31 state-of-the-art methods, validating its robustness and effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。