针对长尾分布下的领域泛化难题,提出负样本主导的对比学习方法。
Negatives-Dominant Contrastive Learning for Generalization in Imbalanced Domains
- 以负样本为主信号增强类别间边界分离
- 提升少数类梯度信号,避免多数类偏差
- 适合处理标签与领域不平衡的复杂场景
不平衡领域泛化(IDG)旨在缓解领域和标签偏移对模型决策边界的影响,尤其在跨域异构长尾分布下尤为关键。尽管其具有重要实际意义,但因技术复杂性及理论基础薄弱而研究不足。本文首次从理论上建立IDG的泛化界,揭示后验差异与决策边界间距的作用。受此启发,提出负样本主导的对比学习(NDCL),通过强化负样本信号提升类别可分性,并利用重加权交叉熵促进类内紧凑性,结合预测中心对齐策略保障跨域后验一致性。在多个基准上进行严格验证,结果表明该方法显著提升性能。代码已开源。
原文摘要 · Abstract (English)
Imbalanced Domain Generalization (IDG) focuses on mitigating both domain and label shifts, both of which fundamentally shape the model's decision boundaries, particularly under heterogeneous long-tailed distributions across domains. Despite its practical significance, it remains underexplored, primarily due to the technical complexity of handling their entanglement and the paucity of theoretical foundations. In this paper, we begin by theoretically establishing the generalization bound for IDG, highlighting the role of posterior discrepancy and decision margin. This bound motivates us to focus on directly steering decision boundaries, marking a clear departure from existing methods. Subsequently, we technically propose a novel Negative-Dominant Contrastive Learning (NDCL) for IDG to enhance discriminability while enforce posterior consistency across domains. Specifically, inter-class decision-boundary separation is enhanced by placing greater emphasis on negatives as the primary signal in our contrastive learning, naturally amplifying gradient signals for minority classes to avoid the decision boundary being biased toward majority classes. Meanwhile, intra-class compactness is encouraged through a re-weighted cross-entropy strategy, and posterior consistency across domains is enforced through a prediction-central alignment strategy. Finally, rigorous yet challenging experiments on benchmarks validate the effectiveness of our NDCL. The code is available at https://github.com/Alrash/NDCL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。