通过双流特征增强提升模型在未知域的泛化能力。
Dual-stream Feature Augmentation for Domain Generalization
- 构建两类硬特征:跨域扰动特征与因果解耦特征,增强模型鲁棒性。
- 在多个数据集上达到当前最优性能,显著提升未见域表现。
- 适合关注领域泛化、模型鲁棒性提升的研究者使用。
领域泛化(DG)旨在从源域学习一个鲁棒模型,以应对分布外(OOD)问题。为提升模型在未见域的泛化能力,增加训练样本多样性是有效策略。然而,现有增强方法存在局限:一方面,多数DG方法的增强方式随机性强,模型难以充分接触逼近最坏情况的扰动特征,导致特征可迁移性未被充分利用;另一方面,判别特征中的因果关系未被考虑,错误关联会损害模型泛化能力。为此,本文提出双流特征增强(DFA)方法,从两个角度构造硬特征。首先,通过不确定性引导生成跨域虚构特征,模拟领域偏移,提升特征可迁移性;其次,利用对抗掩码解耦非因果的伪相关特征,提取更具判别性的因果特征。不同于以往固定合成策略,两种增强被整合进统一可学习的特征解耦模型中。在此基础上,采用对比学习保持语义一致性,进一步提升模型鲁棒性。大量实验表明,该方法在多个数据集上均达到当前最优性能。代码已开源:https://github.com/alusi123/DFA。
原文摘要 · Abstract (English)
Domain generalization (DG) task aims to learn a robust model from source domains that could handle the out-of-distribution (OOD) issue. In order to improve the generalization ability of the model in unseen domains, increasing the diversity of training samples is an effective solution. However, existing augmentation approaches always have some limitations. On the one hand, the augmentation manner in most DG methods is not enough as the model may not see the perturbed features in approximate the worst case due to the randomness, thus the transferability in features could not be fully explored. On the other hand, the causality in discriminative features is not involved in these methods, which harms the generalization ability of model due to the spurious correlations. To address these issues, we propose a Dual-stream Feature Augmentation~(DFA) method by constructing some hard features from two perspectives. Firstly, to improve the transferability, we construct some targeted features with domain related augmentation manner. Through the guidance of uncertainty, some hard cross-domain fictitious features are generated to simulate domain shift. Secondly, to take the causality into consideration, the spurious correlated non-causal information is disentangled by an adversarial mask, then the more discriminative features can be extracted through these hard causal related information. Different from previous fixed synthesizing strategy, the two augmentations are integrated into a unified learnable feature disentangle model. Based on these hard features, contrastive learning is employed to keep the semantic consistency and improve the robustness of the model. Extensive experiments on several datasets demonstrated that our approach could achieve state-of-the-art performance for domain generalization. Our code is available at: https://github.com/alusi123/DFA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。