提出新方法提升跨域泛化能力,避免传统对齐导致的判别信息丢失。
Guidance Not Obstruction: A Conjugate Consistent Enhanced Strategy for Domain Generalization
- 从类角度出发,通过元分布生成多样域相关条件分布
- 引入反馈机制增强分类器对未知域的适应性,实验显示性能优于现有方法
- 计算开销小,适合实际部署,尤其适用于数据分布不稳定的场景
领域泛化应对真实应用中的分布偏移问题。现有方法多采用领域视角,通过对齐各领域的边缘分布来寻找不变表示,忽略类别内部差异,导致判别信息不足。转向类别视角后发现,同一类别在不同领域中会形成多个分布峰或聚类,表明边缘对齐无法保证条件对齐,从而影响泛化效果。因此,我们主张在领域内保持类间判别能力至关重要。为此,提出基于领域元分布的共轭一致增强模块Con2EM,设计分布级Universum策略生成多样化的域相关类条件分布,通过重采样为原始实例级分类器提供反馈,提升其对目标无关域的适应性。为确保生成质量,额外构建分布级分类器以正则化这些条件分布。大量实验验证了该方法的有效性与低计算成本,显著优于当前最优方法。
原文摘要 · Abstract (English)
Domain generalization addresses domain shift in real-world applications. Most approaches adopt a domain angle, seeking invariant representation across domains by aligning their marginal distributions, irrespective of individual classes, naturally leading to insufficient exploration of discriminative information. Switching to a class angle, we find that multiple domain-related peaks or clusters within the same individual classes must emerge due to distribution shift. In other words, marginal alignment does not guarantee conditional alignment, leading to suboptimal generalization. Therefore, we argue that acquiring discriminative generalization between classes within domains is crucial. In contrast to seeking distribution alignment, we endeavor to safeguard domain-related between-class discrimination. To this end, we devise a novel Conjugate Consistent Enhanced Module, namely Con2EM, based on a distribution over domains, i.e., a meta-distribution. Specifically, we employ a novel distribution-level Universum strategy to generate supplementary diverse domain-related class-conditional distributions, thereby enhancing generalization. This allows us to resample from these generated distributions to provide feedback to the primordial instance-level classifier, further improving its adaptability to the target-agnostic. To ensure generation accuracy, we establish an additional distribution-level classifier to regularize these conditional distributions. Extensive experiments have been conducted to demonstrate its effectiveness and low computational cost compared to SOTAs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。