用强化学习自动选中间域,提升连续域适应效果
Reinforced Domain Selection for Continuous Domain Adaptation
- 用强化学习+特征解耦自动选最优域迁移路径
- 在旋转MNIST和ADNI上准确率显著提升
- 无需标签数据,适合无监督域适应场景
连续域适应(CDA)通过从源域经由中间域逐步适应到目标域,有效缓解域间显著差异。然而,缺乏显式元数据时选择中间域仍是未被充分探索的关键挑战。为此,我们提出一种新框架,结合强化学习与特征解耦,在无监督CDA设置下实现域路径选择。该方法引入创新的无监督奖励机制,利用潜在域嵌入间的距离识别最优迁移路径;通过特征解耦,基于域特定特征计算无监督奖励,并对齐域不变特征以促进适应。该策略同步优化迁移路径与目标任务性能,提升域适应效率。在Rotated MNIST和ADNI等数据集上的大量实验表明,预测准确率与域选择效率均有显著提升,优于传统CDA方法。
原文摘要 · Abstract (English)
Continuous Domain Adaptation (CDA) effectively bridges significant domain shifts by progressively adapting from the source domain through intermediate domains to the target domain. However, selecting intermediate domains without explicit metadata remains a substantial challenge that has not been extensively explored in existing studies. To tackle this issue, we propose a novel framework that combines reinforcement learning with feature disentanglement to conduct domain path selection in an unsupervised CDA setting. Our approach introduces an innovative unsupervised reward mechanism that leverages the distances between latent domain embeddings to facilitate the identification of optimal transfer paths. Furthermore, by disentangling features, our method facilitates the calculation of unsupervised rewards using domain-specific features and promotes domain adaptation by aligning domain-invariant features. This integrated strategy is designed to simultaneously optimize transfer paths and target task performance, enhancing the effectiveness of domain adaptation processes. Extensive empirical evaluations on datasets such as Rotated MNIST and ADNI demonstrate substantial improvements in prediction accuracy and domain selection efficiency, establishing our method's superiority over traditional CDA approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。