arXiv:2605.15775cs.LG2026-05被引 1

让模型持续学习跨域通用特征,提升未知场景下的泛化能力。

Continual Learning of Domain-Invariant Representations

论文配图:Continual Learning of Domain-Invariant Representations
图 1 · 摘自论文原文
  • 通过序列不变性对齐,持续学习跨域共性特征
  • 在六大数据集上显著优于现有方法的未知域泛化性能
  • 适合需要长期适应新环境的部署场景

持续学习(CL)旨在不遗忘已有知识的前提下,依次在多个领域训练模型。然而,现有方法侧重于单领域表现,易学习到虚假的、与特定领域相关的线索(“捷径学习”),限制了模型在部署后对未见领域的泛化能力。本文提出持续学习域不变表示的方法,引入一类广泛适用的CL框架,用于顺序学习捕捉跨领域共性结构的表示。该方法基于观察:此类不变结构常反映底层因果机制,有助于降低对领域特异性线索的过拟合,从而提升跨域泛化能力。所提方法结合回放训练与定制化的序列不变性对齐策略,实现对不变结构的持续学习与保留。在面向部署的评估协议下,针对视觉、医学、制造和生态等六项基准与真实世界数据集进行测试,本方法在未知目标域上的表现持续优于现有CL基线。消融实验进一步表明,简单扩展现有域不变表示学习(DIRL)方法至序列场景仅带来有限收益。据我们所知,这是首个为持续学习设计域不变表示的学习工作。

原文摘要 · Abstract (English)

Continual learning (CL) aims to train models sequentially over multiple domains without forgetting previously learned knowledge. However, existing CL methods optimize for in-domain performance and are therefore prone to learning spurious, domain-specific cues (``shortcut learning''), which limits generalization to unseen domains after deployment. In this paper, we address this limitation through continual learning of domain-invariant representation. We introduce a broad class of CL methods that sequentially learn representations capturing invariant structures across domains. Our methods are motivated by the observation that such invariant structures often preserve the underlying causal mechanisms, which can reduce the risk of overfitting to domain-specific cues and thus offer better out-of-domain generalization. Our proposed CL methods combine replay-based training with a tailored sequential invariance alignment to learn -- and preserve -- invariant structures over time. We evaluate our methods under a deployment-oriented protocol that measures performance on unseen target domains. Across six benchmark and real-world datasets spanning vision, medicine, manufacturing, and ecology, our methods consistently outperform existing CL baselines in terms of generalization to unseen target domains. As an ablation, we further show that naïve extensions of sequential training with existing domain-invariant representation learning (DIRL) methods provide only limited benefits. To the best of our knowledge, this is the first work to develop domain-invariant representation methods for CL.

持续学习域不变泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。