用生成模型捕捉领域特有信息,提升视觉模型跨域泛化能力
Generative Classifier for Domain Generalization
- 采用高斯混合模型建模每类在各领域的特征分布,挖掘领域特有信息
- 在五个基准上达到与主流方法相当的性能,且可无缝集成现有方法
- 通过三模块设计有效防止伪相关学习,平衡多模态成分贡献
领域泛化(DG)旨在提升计算机视觉模型对分布偏移的泛化能力。主流方法聚焦于学习领域不变特征,却忽视了领域特有信息的潜力。传统的判别线性分类器针对领域不变特征优化,难以应对包含类内变化等多模态的领域特有信息。本文揭示了依赖领域不变性的理论局限,强调领域特有信息在降低目标风险中的关键作用。基于此,提出生成式分类器驱动的领域泛化框架GCDG,为每个类别在各领域构建基于高斯混合模型(GMM)的生成式分类器。GCDG包含三个核心模块:异质性学习分类器(HLC)通过GMM建模特征分布以捕获领域特有信息;伪相关阻断(SCB)识别并扰动包含伪相关性的神经单元,避免学习虚假模式;多样组件平衡(DCB)确保HLC中各成分均衡贡献,防止关键成分被低估或忽略。实验表明,GCDG能有效捕捉多样化分布下的领域特有信息,在五个领域泛化基准和一个面部反欺骗数据集上表现优异,且可无缝集成至现有方法中实现一致提升。
原文摘要 · Abstract (English)
Domain generalization (DG) aims to improve the generalizability of computer vision models toward distribution shifts. The mainstream DG methods focus on learning domain invariance, however, such methods overlook the potential inherent in domain-specific information. While the prevailing practice of discriminative linear classifier has been tailored to domain-invariant features, it struggles when confronted with diverse domain-specific information, e.g., intra-class shifts, that exhibits multi-modality. To address these issues, we explore the theoretical implications of relying on domain invariance, revealing the crucial role of domain-specific information in mitigating the target risk for DG. Drawing from these insights, we propose Generative Classifier-driven Domain Generalization (GCDG), introducing a generative paradigm for the DG classifier based on Gaussian Mixture Models (GMMs) for each class across domains. GCDG consists of three key modules: Heterogeneity Learning Classifier~(HLC), Spurious Correlation Blocking~(SCB), and Diverse Component Balancing~(DCB). Concretely, HLC attempts to model the feature distributions and thereby capture valuable domain-specific information via GMMs. SCB identifies the neural units containing spurious correlations and perturbs them, mitigating the risk of HLC learning spurious patterns. Meanwhile, DCB ensures a balanced contribution of components in HLC, preventing the underestimation or neglect of critical components. In this way, GCDG excels in capturing the nuances of domain-specific information characterized by diverse distributions. GCDG demonstrates the potential to reduce the target risk and encourage flat minima, improving the generalizability. Extensive experiments show GCDG's comparable performance on five DG benchmarks and one face anti-spoofing dataset, seamlessly integrating into existing DG methods with consistent improvements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。