arXiv:2409.08557cs.CV2024-09被引 2

提出DICS模型,让模型同时学不变特征和类专属特征,提升分布外泛化能力。

DICS: Find Domain-Invariant and Class-Specific Features for Out-of-Distribution Generalization

  • 设计双测试机制:先剔除域相关特征,再强化类专属特征。
  • 在多个基准上验证,显著提升模型在分布外场景的准确率。
  • 适合研究鲁棒视觉识别、对抗分布偏移的科研人员。

尽管深度神经网络在多种视觉任务中取得了显著进展,但在分布外(OOD)场景下其性能通常会下降。许多现有方法专注于提取域不变特征,却忽略了这些特征是否具有类唯一性。即使某些特征是域不变的,若在不同类别间共享,则无法作为关键分类依据。在OOD任务中,域相关特征和类共享特征均构成混杂因子,阻碍泛化。本文提出DICS模型,通过域不变性测试(DIT)和类特异性测试(CST),提取域不变且类特定的特征,缓解混杂因子引入的伪相关。DIT学习每个源域的域相关特征并从输入中去除,以隔离域不变的类相关特征,并通过跨域同类别特征对齐确保域不变性。随后,CST通过对比前步学习的特征计算软标签,优化软标签与真实标签间的交叉熵,增强同类别相似性和异类别区分度,从而强化类特异性。大量实验表明该算法有效,可视化进一步证明DICS能准确识别目标域中每类的关键特征。

原文摘要 · Abstract (English)

While deep neural networks have made remarkable progress in various vision tasks, their performance typically deteriorates when tested in out-of-distribution (OOD) scenarios. Many OOD methods focus on extracting domain-invariant features but neglect whether these features are unique to each class. Even if some features are domain-invariant, they cannot serve as key classification criteria if shared across different classes. In OOD tasks, both domain-related and class-shared features act as confounders that hinder generalization. In this paper, we propose a DICS model to extract Domain-Invariant and Class-Specific features, including Domain Invariance Testing (DIT) and Class Specificity Testing (CST), which mitigate the effects of spurious correlations introduced by confounders. DIT learns domain-related features of each source domain and removes them from inputs to isolate domain-invariant class-related features. DIT ensures domain invariance by aligning same-class features across different domains. Then, CST calculates soft labels for those features by comparing them with features learned in previous steps. We optimize the cross-entropy between the soft labels and their true labels, which enhances same-class similarity and different-class distinctiveness, thereby reinforcing class specificity. Extensive experiments on widely-used benchmarks demonstrate the effectiveness of our proposed algorithm. Additional visualizations further demonstrate that DICS effectively identifies the key features of each class in target domains.

分布外泛化域不变特征类特异性鲁棒学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。