arXiv:2412.09073cs.CVcs.LG2024-12被引 11

通过自多样性对抗风格扰动,提升跨域少样本学习的泛化能力。

SVasP: Self-Versatility Adversarial Style Perturbation for Cross-Domain Few-Shot Learning

  • 利用多尺度裁剪与对抗风格梯度聚合,实现图像内自多样性风格扰动。
  • 在多个基准数据集上显著超越现有最优方法,准确率提升明显。
  • 适合研究跨域迁移、少样本学习及模型鲁棒性增强的开发者。

跨域少样本学习(CD-FSL)旨在将已知源域的知识迁移到未知目标域,对评估模型的泛化与鲁棒性至关重要。现有基于视觉风格的方法面临梯度不稳和陷入局部极小的问题。本文提出一种新型全局裁剪风格扰动方法——自多样性对抗风格扰动(SVasP),通过多样化输入模式并聚合局部裁剪风格梯度,生成图像内稳定的全局风格扰动,实现梯度稳定与逃离劣质尖锐极小值的联合优化。设计了新目标函数,在保持语义一致性的同时最大化全局、裁剪与对抗特征间的视觉差异。训练中获得稳定的全局风格扰动后,模型损失曲面趋于平坦,显著提升向目标域的迁移能力。在多个基准数据集上的大量实验表明,本方法显著优于现有最先进方法。代码已开源:https://github.com/liwenqianSEU/SVasP。

原文摘要 · Abstract (English)

Cross-Domain Few-Shot Learning (CD-FSL) aims to transfer knowledge from seen source domains to unseen target domains, which is crucial for evaluating the generalization and robustness of models. Recent studies focus on utilizing visual styles to bridge the domain gap between different domains. However, the serious dilemma of gradient instability and local optimization problem occurs in those style-based CD-FSL methods. This paper addresses these issues and proposes a novel crop-global style perturbation method, called \underline{\textbf{S}}elf-\underline{\textbf{V}}ersatility \underline{\textbf{A}}dversarial \underline{\textbf{S}}tyle \underline{\textbf{P}}erturbation (\textbf{SVasP}), which enhances the gradient stability and escapes from poor sharp minima jointly. Specifically, SVasP simulates more diverse potential target domain adversarial styles via diversifying input patterns and aggregating localized crop style gradients, to serve as global style perturbation stabilizers within one image, a concept we refer to as self-versatility. Then a novel objective function is proposed to maximize visual discrepancy while maintaining semantic consistency between global, crop, and adversarial features. Having the stabilized global style perturbation in the training phase, one can obtain a flattened minima in the loss landscape, boosting the transferability of the model to the target domains. Extensive experiments on multiple benchmark datasets demonstrate that our method significantly outperforms existing state-of-the-art methods. Our codes are available at https://github.com/liwenqianSEU/SVasP.

少样本学习跨域迁移风格扰动对抗训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。