提出新方法提升跨域少样本学习的泛化能力
SRasP: Self-Reorientation Adversarial Style Perturbation for Cross-Domain Few-Shot Learning
- 通过全局语义引导重构风格梯度,稳定训练过程
- 在多个基准上显著优于现有最先进方法
- 适合研究跨域迁移与模型鲁棒性的学者
跨域少样本学习(CD-FSL)旨在将已见源域的知识迁移到未见目标域,是评估模型鲁棒性与可迁移性的关键基准。现有基于风格扰动的方法虽能缓解域偏移,但常面临梯度不稳和收敛至尖锐极小值的问题。为此,本文提出一种新型裁剪-全局风格扰动网络,称为自重定向对抗风格扰动(SRasP)。SRasP利用全局语义引导识别不一致的图像裁剪区域,随后将这些裁剪区域的风格梯度与图像内全局风格梯度进行重定向与聚合。此外,提出一种新的多目标优化函数,在最大化视觉差异的同时,强制全局、裁剪与对抗特征间的语义一致性。训练中应用稳定的扰动可促使模型收敛至更平坦且更具可迁移性的解,从而提升对未见域的泛化性能。在多个CD-FSL基准上的大量实验表明,该方法持续优于当前最先进方法。
原文摘要 · Abstract (English)
Cross-Domain Few-Shot Learning (CD-FSL) aims to transfer knowledge from a seen source domain to unseen target domains, serving as a key benchmark for evaluating the robustness and transferability of models. Existing style-based perturbation methods mitigate domain shift but often suffer from gradient instability and convergence to sharp minima.To address these limitations, we propose a novel crop-global style perturbation network, termed Self-Reorientation Adversarial \underline{S}tyle \underline{P}erturbation (SRasP). Specifically, SRasP leverages global semantic guidance to identify incoherent crops, followed by reorienting and aggregating the style gradients of these crops with the global style gradients within one image. Furthermore, we propose a novel multi-objective optimization function to maximize visual discrepancy while enforcing semantic consistency among global, crop, and adversarial features. Applying the stabilized perturbations during training encourages convergence toward flatter and more transferable solutions, improving generalization to unseen domains. Extensive experiments are conducted on multiple CD-FSL benchmarks, demonstrating consistent improvements over state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。