arXiv:2510.13864cs.LGcs.AI2025-10NeurIPS被引 2

动态加权自训练,让模型逐步适应新领域更稳定高效。

Self-Training with Dynamic Weighting for Robust Gradual Domain Adaptation

  • 用随时间变化的权重动态平衡源域和目标域损失。
  • 在多个数据集上优于现有方法,显著减少领域偏差。
  • 适合需要逐步迁移知识的实际场景,如持续学习系统。

本文提出一种名为自训练动态加权(STDW)的新方法,旨在通过解决从源域到目标域平滑迁移知识的挑战,提升渐进式域适应(GDA)的鲁棒性。传统GDA方法通过中间域和自训练缓解域偏移,但常面临知识迁移效率低或中间数据不完整的问题。本文引入动态加权机制,自适应调节源域与目标域损失的贡献权重。具体地,设计了一个由时变超参数$ ho$(从0到1递增)控制的优化框架,调节域特定学习强度,确保适应过程稳定。方法利用自训练生成伪标签,并优化加权目标函数实现迭代模型更新,保持跨中间域的鲁棒性。在旋转MNIST、颜色偏移MNIST、人像数据集及Cover Type数据集上的实验表明,STDW优于现有基线。消融研究进一步验证了$ ho$动态调度的关键作用,证实其在降低域偏差和提升泛化能力方面的有效性。本工作为鲁棒渐进域适应提供了理论洞见与实用框架,适用于动态现实场景。代码已开源:https://github.com/Dramwig/STDW。

原文摘要 · Abstract (English)

In this paper, we propose a new method called Self-Training with Dynamic Weighting (STDW), which aims to enhance robustness in Gradual Domain Adaptation (GDA) by addressing the challenge of smooth knowledge migration from the source to the target domain. Traditional GDA methods mitigate domain shift through intermediate domains and self-training but often suffer from inefficient knowledge migration or incomplete intermediate data. Our approach introduces a dynamic weighting mechanism that adaptively balances the loss contributions of the source and target domains during training. Specifically, we design an optimization framework governed by a time-varying hyperparameter $\varrho$ (progressing from 0 to 1), which controls the strength of domain-specific learning and ensures stable adaptation. The method leverages self-training to generate pseudo-labels and optimizes a weighted objective function for iterative model updates, maintaining robustness across intermediate domains. Experiments on rotated MNIST, color-shifted MNIST, portrait datasets, and the Cover Type dataset demonstrate that STDW outperforms existing baselines. Ablation studies further validate the critical role of $\varrho$'s dynamic scheduling in achieving progressive adaptation, confirming its effectiveness in reducing domain bias and improving generalization. This work provides both theoretical insights and a practical framework for robust gradual domain adaptation, with potential applications in dynamic real-world scenarios. The code is available at https://github.com/Dramwig/STDW.

域适应自训练动态加权渐进学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。