通过动态调整迁移强度,实现跨域知识平滑迁移
GDO:Gradual Domain Osmosis
- 用可变超参数λ控制源域与目标域损失权重,逐步增强知识迁移
- 在旋转MNIST等4个数据集上均超越基线方法,提升跨域泛化能力
- 适合需要渐进式适应的动态环境,如实时场景变化下的模型部署
本文提出一种名为渐进域渗透(GDO)的新方法,旨在解决渐进域自适应(GDA)中知识从源域到目标域平滑迁移的问题。传统GDA方法通过引入中间域和自训练策略缓解域偏移,但常面临知识迁移效率低或中间域数据缺失的挑战。本文设计了一种基于超参数λ的优化框架,动态平衡源域与目标域的损失权重,使模型在训练过程中逐步增强知识迁移强度(λ从0递增至1),从而更高效地实现跨域泛化。该方法结合自训练生成伪标签,并通过最小化加权损失函数迭代更新模型,确保在中间域渐进适应过程中的稳定性与鲁棒性。实验在旋转MNIST、色彩偏移MNIST、人像数据集和森林覆盖类型数据集上验证了该方法的有效性,结果表明其优于现有基线方法。消融实验进一步分析了λ动态调节策略对性能的影响,证实渐进域渗透在缓解域偏移和提升模型泛化能力方面的优势。研究为渐近域自适应提供了理论支持与实践框架,拓展了其在动态环境中的应用潜力。
原文摘要 · Abstract (English)
In this paper, we propose a new method called Gradual Domain Osmosis, which aims to solve the problem of smooth knowledge migration from source domain to target domain in Gradual Domain Adaptation (GDA). Traditional Gradual Domain Adaptation methods mitigate domain bias by introducing intermediate domains and self-training strategies, but often face the challenges of inefficient knowledge migration or missing data in intermediate domains. In this paper, we design an optimisation framework based on the hyperparameter $λ$ by dynamically balancing the loss weights of the source and target domains, which enables the model to progressively adjust the strength of knowledge migration ($λ$ incrementing from 0 to 1) during the training process, thus achieving cross-domain generalisation more efficiently. Specifically, the method incorporates self-training to generate pseudo-labels and iteratively updates the model by minimising a weighted loss function to ensure stability and robustness during progressive adaptation in the intermediate domain. The experimental part validates the effectiveness of the method on rotated MNIST, colour-shifted MNIST, portrait dataset and forest cover type dataset, and the results show that it outperforms existing baseline methods. The paper further analyses the impact of the dynamic tuning strategy of the hyperparameter $λ$ on the performance through ablation experiments, confirming the advantages of progressive domain penetration in mitigating the domain bias and enhancing the model generalisation capability. The study provides a theoretical support and practical framework for asymptotic domain adaptation and expands its application potential in dynamic environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。