用智能混合生成数据,提升模型跨域泛化能力。
Single Domain Generalization with Model-aware Parametric Batch-wise Mixup
- 基于注意力机制设计可参数化混合网络,动态生成适应性合成数据。
- 在多个基准数据集上达到当前最优单域泛化性能。
- 适合需要强跨域适应能力的工业部署场景。
单域泛化(SDG)是机器学习中的重大挑战,尤其当模型部署环境与训练域差异显著时。本文提出一种新型数据增强方法——模型感知参数化批混合(MPBM),通过随机梯度朗之万动力学生成对抗性查询,并利用带有创新注意力机制的参数化批混合生成网络,生成具有模型感知特性的合成样本。该方法通过捕捉特征间相关性,在批次内灵活组合特征,提升合成样本的适应性与信息量。生成的合成数据能显著扩展原始训练数据的表示空间,从而增强模型在多样且未见域上的泛化能力。为防止数据偏离训练分布,引入基于真实数据对齐的对抗损失,抑制过度扩张。在多个基准数据集上的实验表明,采用MPBM增强训练集后,模型在单域泛化任务中达到当前最优表现。
原文摘要 · Abstract (English)
Single Domain Generalization (SDG) remains a formidable challenge in the field of machine learning, particularly when models are deployed in environments that differ significantly from their training domains. In this paper, we propose a novel data augmentation approach, named as Model-aware Parametric Batch-wise Mixup (MPBM), to tackle the challenge of SDG. MPBM deploys adversarial queries generated with stochastic gradient Langevin dynamics, and produces model-aware augmenting instances with a parametric batch-wise mixup generator network that is carefully designed through an innovative attention mechanism. By exploiting inter-feature correlations, the parameterized mixup generator introduces additional versatility in combining features across a batch of instances, thereby enhancing the capacity to generate highly adaptive and informative synthetic instances for specific queries. The synthetic data produced by this adaptable generator network, guided by informative queries, is expected to significantly enrich the representation space covered by the original training dataset and subsequently enhance the prediction model's generalizability across diverse and previously unseen domains. To prevent excessive deviation from the training data, we further incorporate a real-data alignment-based adversarial loss into the learning process of MPBM, regularizing any tendencies toward undesirable expansions. We conduct extensive experiments on several benchmark datasets. The empirical results demonstrate that by augmenting the training set with informative synthesis data, our proposed MPBM method achieves the state-of-the-art performance for single domain generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。