arXiv:2602.02015cs.LG2026-02

解决标签分布与条件分布同时变化下的模型泛化问题

Robust Domain Generalization under Divergent Marginal and Conditional Distributions

  • 分解联合分布,分别处理边缘与条件分布偏移
  • 在多个基准上达到领先性能,长尾场景效果显著
  • 适合应对真实世界中复杂分布变化的场景

领域泛化(DG)旨在学习能在未见领域上表现良好的预测模型。现有方法多假设条件分布变化(即主要关注P(X|Y)的变化,而假设标签边缘分布P(Y)稳定)。然而,真实多领域场景常存在复合分布偏移,即边缘分布P(Y)和条件分布P(X|Y)同时变化。为此,本文提出一个统一框架,用于在边缘与条件分布均发散的情况下实现鲁棒的领域泛化。通过将联合分布显式分解为边缘与条件部分,推导出面向未见领域的新型风险上界,并刻画由两类偏移引发的风险差距。为实现该上界,设计了一种元学习过程,在已知领域上最小化并验证该风险上界,以确保对未见领域的强泛化能力。实验表明,该方法不仅在传统DG基准上取得领先性能,还在边缘与条件偏移均显著的多领域长尾识别任务中表现优异。

原文摘要 · Abstract (English)

Domain generalization (DG) aims to learn predictive models that can generalize to unseen domains. Most existing DG approaches focus on learning domain-invariant representations under the assumption of conditional distribution shift (i.e., primarily addressing changes in $P(X\mid Y)$ while assuming $P(Y)$ remains stable). However, real-world scenarios with multiple domains often involve compound distribution shifts where both the marginal label distribution $P(Y)$ and the conditional distribution $P(X\mid Y)$ vary simultaneously. To address this, we propose a unified framework for robust domain generalization under divergent marginal and conditional distributions. We derive a novel risk bound for unseen domains by explicitly decomposing the joint distribution into marginal and conditional components and characterizing risk gaps arising from both sources of divergence. To operationalize this bound, we design a meta-learning procedure that minimizes and validates the proposed risk bound across seen domains, ensuring strong generalization to unseen ones. Empirical evaluations demonstrate that our method achieves state-of-the-art performance not only on conventional DG benchmarks but also in challenging multi-domain long-tailed recognition settings where both marginal and conditional shifts are pronounced.

领域泛化分布偏移长尾识别元学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。