arXiv:2502.10716cs.LGstat.ML2025-02被引 2

揭示域泛化失效根源,提出必要与充分条件新视角

Why Domain Generalization Fail? A View of Necessity and Sufficiency

  • 从必要与充分条件角度重新分析域泛化机制
  • 发现现有方法满足充分条件却违背必要条件
  • 提出子空间对齐策略,兼顾必要性与可推广性

尽管域泛化(DG)具有坚实的理论基础,但实证实验显示其算法常无法持续优于经验风险最小化(ERM)基线。本文认为,问题源于多数研究在不切实际的假设下建立理论保证,如存在足够多样(甚至无限)的域或目标域知识。因此,在训练域有限的情况下,域泛化的真实可行性仍不清楚。本文通过必要性与充分性视角系统构建了一组通用性成立的充要条件。分析表明,现有DG方法主要作为正则化机制以满足充分条件,却忽视了必要条件。然而,在训练域有限时,充分条件无法验证。此时,针对充分条件的正则化仅提升泛化可能性,而针对必要条件的正则化才能确保泛化存在。我们揭示了现有算法虽促进充分条件,却无意违反必要条件。为验证理论,提出一种新方法:通过新颖的子空间表示对齐,同时满足必要与充分条件。该方法在多个主流DG基准上表现更优。

原文摘要 · Abstract (English)

Despite a strong theoretical foundation, empirical experiments reveal that existing domain generalization (DG) algorithms often fail to consistently outperform the ERM baseline. We argue that this issue arises because most DG studies focus on establishing theoretical guarantees for generalization under unrealistic assumptions, such as the availability of sufficient, diverse (or even infinite) domains or access to target domain knowledge. As a result, the extent to which domain generalization is achievable in scenarios with limited domains remains largely unexplored. This paper seeks to address this gap by examining generalization through the lens of the conditions necessary for its existence and learnability. Specifically, we systematically establish a set of necessary and sufficient conditions for generalization. Our analysis highlights that existing DG methods primarily act as regularization mechanisms focused on satisfying sufficient conditions, while often neglecting necessary ones. However, sufficient conditions cannot be verified in settings with limited training domains. In such cases, regularization targeting sufficient conditions aims to maximize the likelihood of generalization, whereas regularization targeting necessary conditions ensures its existence. Using this analysis, we reveal the shortcomings of existing DG algorithms by showing that, while they promote sufficient conditions, they inadvertently violate necessary conditions. To validate our theoretical insights, we propose a practical method that promotes the sufficient condition while maintaining the necessary conditions through a novel subspace representation alignment strategy. This approach highlights the advantages of preserving the necessary conditions on well-established DG benchmarks.

域泛化机器学习理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。