通过频域与像素域联合增强,提升模型在真实场景下的泛化能力。
D-GAP: Improving Out-of-Domain Robustness via Dataset-Agnostic and Gradient-Guided Augmentation in Frequency and Pixel Spaces
- 基于梯度生成频域敏感图,自适应调整频谱幅度。
- 在四个真实数据集上平均提升5.3%的跨域性能。
- 无需领域先验知识,适合部署于复杂多变的真实场景。
真实世界计算机视觉应用中,图像背景、风格和采集设备的变化常导致模型性能下降。通用增强方法在这些变化下表现不一,而特定数据集的增强需专家知识和前期分析。此外,神经网络对域偏移适应差,因其对域特定频域成分存在学习偏差。扰动频域值可缓解该偏差,但忽略像素级细节,导致性能不佳。为此,本文提出D-GAP:一种数据集无关且梯度引导的频域与像素域增强方法。D-GAP从任务梯度生成频域敏感图,反映模型对不同频率成分的响应强度,并据此在源与目标样本间自适应插值幅度,降低频域学习偏差;同时,补充的像素域混合过程恢复精细空间细节。在四个真实世界数据集和三个域适应基准上的实验表明,D-GAP始终优于通用及特定数据集的域适应方法,在真实数据集上平均提升5.3%,在基准数据集上提升1.9%。
原文摘要 · Abstract (English)
Out-of-domain (OOD) robustness is challenging to achieve in real-world computer vision applications, where shifts in image background, style, and acquisition instruments always degrade model performance. Generic augmentations show inconsistent gains under such shifts, whereas dataset-specific augmentations require expert knowledge and prior analysis. Moreover, prior studies show that neural networks adapt poorly to domain shifts because they exhibit a learning bias to domain-specific frequency components. Perturbing frequency values can mitigate such bias but overlooks pixel-level details, leading to suboptimal performance. To address these problems, we propose D-GAP, a Dataset-agnostic and Gradient-guided augmentation method for the Amplitude spectrum (in frequency space) and the Pixel values, improving OOD robustness by introducing targeted augmentation in both frequency and pixel spaces. Unlike conventional handcrafted augmentations, D-GAP computes sensitivity maps in the frequency space from task gradients, which reflect how strongly the deep models respond to different frequency components, and uses the maps to adaptively interpolate amplitudes between source and target samples. This way, D-GAP reduces the learning bias in frequency space, while a complementary pixel-space blending procedure restores fine spatial details. Extensive experiments on four real-world datasets and three domain-adaptation benchmarks show that D-GAP consistently outperforms both generic and dataset-specific domain adaptation methods, improving average OOD performance by +5.3% on real-world datasets and +1.9% on benchmark datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。