用合成数据提升模型泛化能力,解决真实与合成数据分布差异问题
Let Synthetic Data Shine: Domain Reassembly and Soft-Fusion for Single Domain Generalization
- 通过重构合成数据特征分布,消除虚假噪声
- 在多个任务上实现显著性能提升,计算开销极低
- 可无缝接入现有方法,适合实际场景部署
单域泛化(SDG)旨在仅使用单一来源数据训练出在多种场景下表现稳定模型。尽管潜在扩散模型(LDMs)在扩充有限源数据方面具有潜力,但我们的分析表明,直接使用合成数据不仅无法带来收益,反而因合成与真实目标域间显著的特征分布差异而损害性能。为此,我们提出判别性域重装与软融合框架(DRSF),利用合成数据提升模型泛化能力。采用LDM生成多样化伪目标域样本,引入两个关键模块:首先,判别性特征解耦与重装(DFDR)模块通过熵引导注意力重新校准通道级特征,抑制合成噪声并保留语义一致性;其次,多伪域软融合(MDSF)模块通过潜在空间特征插值的对抗训练,实现域间连续特征过渡。在图像分类、目标检测和语义分割上的大量实验表明,DRSF在仅增加微量计算开销的情况下实现了显著性能提升。值得注意的是,其即插即用结构可无缝集成至无监督域自适应范式,展现出广泛适用性。
原文摘要 · Abstract (English)
Single Domain Generalization (SDG) aims to train models that maintain consistent performance across diverse scenarios using data from a single source. While latent diffusion models (LDMs) show promise for augmenting limited source data, our analysis reveals that directly employing synthetic data may not only fail to provide benefits but can actually compromise performance due to substantial feature distribution discrepancies between synthetic and real target domains. To address this issue, we propose Discriminative Domain Reassembly and Soft-Fusion (DRSF), a training framework leveraging synthetic data to improve model generalization. We employ LDMs to produce diverse pseudo-target domain samples and introduce two key modules to handle distribution bias. First, Discriminative Feature Decoupling and Reassembly (DFDR) module uses entropy-guided attention to recalibrate channel-level features, suppressing synthetic noise while preserving semantic consistency. Second, Multi-pseudo-domain Soft Fusion (MDSF) module uses adversarial training with latent-space feature interpolation, creating continuous feature transitions between domains. Extensive SDG experiments on image classification, object detection, and semantic segmentation demonstrate that DRSF delivers substantial performance gains with only marginal computational overhead. Notably, DRSF's plug-and-play architecture enables seamless integration with unsupervised domain adaptation paradigms, underscoring its broad applicability to diverse, real-world domain challenges.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。