arXiv:2606.21736cs.CV2026-06CVPR被引 14

用对抗式提示调优生成跨域图像,提升单域泛化能力

Adversarial Domain Prompt Tuning and Generation for Single Domain Generalization

论文配图:Adversarial Domain Prompt Tuning and Generation for Single Domain Generalization
图 1 · 摘自论文原文
  • 通过对抗学习自动优化抽象提示,分离类别与风格信息
  • 在多个未见领域上实现超越现有方法的性能表现
  • 适合需要少样本跨域泛化的视觉模型研究者

单域泛化(SDG)旨在仅使用单一训练域数据的情况下,学习出能在多个未见域上表现良好的鲁棒模型。当前有前景的方向是通过数据增强或图像生成来构造域外(OOD)训练数据。随着AI生成内容(AIGC)的快速发展,本文首次提出利用预训练文本到图像(T2I)基础模型生成训练数据。然而,手动设计适用于所有可能域的文本提示通常不切实际,且部分域特征过于抽象难以文字描述。为此,我们提出一种新颖的渐进式对抗提示调优(PAPT)框架,用于预训练扩散模型。该方法不再依赖静态文本域,而是学习两组抽象提示作为扩散模型的条件:一组捕捉域不变的类别信息,另一组建模域特定风格。这种对抗学习机制使T2I模型能够在保持关键类别特征的同时,生成多种域风格的图像。大量实验表明,所提方法在多个未见域上均显著优于当前最先进的单域泛化方法。

原文摘要 · Abstract (English)

Single domain generalization (SDG) aims to learn a robust model, which could perform well on many unseen domains while there is only one single domain available for training. One of the promising directions for achieving single-domain generalization is to generate out-of-domain (OOD) training data through data augmentation or image generation. Given the rapid advancements in AI-generated content (AIGC), this paper is the first to propose leveraging powerful pre-trained text-to-image (T2I) foundation models to create the training data. However, manually designing textual prompts to generate images for all possible domains is often impractical, and some domain characteristics may be too abstract to describe with words. To address these challenges, we propose a novel Progressive Adversarial Prompt Tuning (PAPT) framework for pre-trained diffusion models. Instead of relying on static textual domains, our approach learns two sets of abstract prompts as conditions for the diffusion model: one that captures domain-invariant category information and another that models domain-specific styles. This adversarial learning mechanism enables the T2I model to generate images in various domain styles while preserving key categorical features. Extensive experiments demonstrate the effectiveness of the proposed method, achieving superior performances to state-of-the-art single-domain generalization approaches.

单域泛化扩散模型提示调优AIGC

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。