用全局变分推断提升域适应的稳定性和泛化能力
Global Variational Inference Enhanced Robust Domain Adaptation
- 通过变分推断学习连续的类别条件先验,实现结构感知对齐
- 在38个任务中达到顶尖性能,显著减少伪标签噪声影响
- 适合追求高鲁棒性与理论严谨性的域适应研究者
基于深度学习的域适应方法虽表现强劲,但依赖小批量训练限制了全局分布建模,导致对齐不稳定、泛化性能不佳。本文提出全局变分推断增强的域适应框架(GVI-DA),通过变分推断学习连续的类条件全局先验,实现结构感知的跨域对齐。GVI-DA通过潜在特征重建最小化域间差异,并利用随机采样的全局码本学习缓解后验崩溃。进一步通过剔除低置信度伪标签并生成可靠目标域样本,提升鲁棒性。在四个基准和三十八个域适应任务上实验表明性能持续领先。本文还推导了模型的证据下界(ELBO),分析了先验连续性、码本大小及伪标签噪声容忍度的影响。此外,与基于扩散的生成框架在优化原理和效率上进行比较,凸显其理论严谨性与实际优势。
原文摘要 · Abstract (English)
Deep learning-based domain adaptation (DA) methods have shown strong performance by learning transferable representations. However, their reliance on mini-batch training limits global distribution modeling, leading to unstable alignment and suboptimal generalization. We propose Global Variational Inference Enhanced Domain Adaptation (GVI-DA), a framework that learns continuous, class-conditional global priors via variational inference to enable structure-aware cross-domain alignment. GVI-DA minimizes domain gaps through latent feature reconstruction, and mitigates posterior collapse using global codebook learning with randomized sampling. It further improves robustness by discarding low-confidence pseudo-labels and generating reliable target-domain samples. Extensive experiments on four benchmarks and thirty-eight DA tasks demonstrate consistent state-of-the-art performance. We also derive the model's evidence lower bound (ELBO) and analyze the effects of prior continuity, codebook size, and pseudo-label noise tolerance. In addition, we compare GVI-DA with diffusion-based generative frameworks in terms of optimization principles and efficiency, highlighting both its theoretical soundness and practical advantages.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。