通过统一风格域提升模型在未知场景下的泛化能力
ConstStyle: Robust Domain Generalization with Unified Style Transformation
- 用统一风格域映射所有数据,缩小训练与测试域差距
- 仅用少量已知域时,准确率最高提升19.82%
- 适合训练域少或与测试域差异大的实际场景
深度神经网络在测试数据分布与训练数据不一致时性能常显著下降。领域泛化(DG)旨在通过关注领域不变特征或增强数据多样性来缓解此问题。然而,现有方法在训练域有限或已见域与未见域差异较大时表现不佳。为此,我们提出ConstStyle,一种新方法:利用统一领域捕捉领域不变特征,并通过理论分析实现领域间桥梁构建。训练时,所有样本被映射至该统一领域并优化;测试时,未见域样本也以相同方式投影后预测。通过在统一领域内对齐训练与测试数据,ConstStyle有效降低领域偏移影响,即使在大领域差距或少量训练域条件下仍具鲁棒性。大量实验表明,ConstStyle在多种场景下均优于现有方法。尤其当仅可用少量已见域时,其准确率相较次优方法最高提升19.82%。
原文摘要 · Abstract (English)
Deep neural networks often suffer performance drops when test data distribution differs from training data. Domain Generalization (DG) aims to address this by focusing on domain-invariant features or augmenting data for greater diversity. However, these methods often struggle with limited training domains or significant gaps between seen (training) and unseen (test) domains. To enhance DG robustness, we hypothesize that it is essential for the model to be trained on data from domains that closely resemble unseen test domains-an inherently difficult task due to the absence of prior knowledge about the unseen domains. Accordingly, we propose ConstStyle, a novel approach that leverages a unified domain to capture domain-invariant features and bridge the domain gap with theoretical analysis. During training, all samples are mapped onto this unified domain, optimized for seen domains. During testing, unseen domain samples are projected similarly before predictions. By aligning both training and testing data within this unified domain, ConstStyle effectively reduces the impact of domain shifts, even with large domain gaps or few seen domains. Extensive experiments demonstrate that ConstStyle consistently outperforms existing methods across diverse scenarios. Notably, when only a limited number of seen domains are available, ConstStyle can boost accuracy up to 19.82\% compared to the next best approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。