arXiv:2606.21700cs.CV2026-06

用视觉令牌增强生成式无监督域适应的条件控制,提升合成数据质量。

VT-DUDA: Visual Token Conditioning for Diffusion-guided Unsupervised Domain Adaptation

论文配图:VT-DUDA: Visual Token Conditioning for Diffusion-guided Unsupervised Domain Adaptation
图 1 · 摘自论文原文
  • 引入视觉令牌序列作为生成条件,结合文本嵌入实现实例级引导。
  • 在Office-31等三个数据集上,平均准确率超越现有生成式与判别式基线。
  • 支持推理时动态调整条件信号,适用于需要灵活调控的场景。

无监督域适应(UDA)旨在利用带标签源域数据和无标签目标域数据,在分布偏移下学习目标域分类器。近期基于扩散模型的UDA方法通过合成目标风格图像并在此类数据上训练来解决该问题。然而,其性能高度依赖于条件设计:类别提示仅提供粗粒度指导,而域适应模块主要控制外观,可能导致目标风格合成不够精确。本文提出VT-DUDA,一种用于扩散引导无监督域适应的视觉令牌条件框架。不同于仅依赖文本提示,VT-DUDA利用源图像提供额外的实例级视觉上下文以指导目标风格合成。具体而言,将每个源图像映射为紧凑的视觉令牌序列,并将其与对应文本嵌入沿潜在扩散模型的交叉注意力上下文维度拼接,形成混合条件上下文。这实现了超越文本的实例相关条件,同时合成过程使用目标域适配分支完成。由于引导信息以令牌序列显式表示,该接口还允许在推理阶段通过选择特定令牌或调节强度来操控条件信号。所提方法保持标准扩散目标,可无缝集成至现有适配器基扩散框架中而不修改主干网络。在Office-31、Office-Home和VisDA-2017上,VT-DUDA在平均目标域准确率上优于强大多样性基线。结果表明,在基于生成的UDA中,更强的条件接口能提升合成目标风格数据的下游有用性。

原文摘要 · Abstract (English)

Unsupervised domain adaptation (UDA) aims to learn a target-domain classifier from labeled source data and unlabeled target data under distribution shift. Recent diffusion-based UDA methods approach this problem by synthesizing labeled target-style images and training on the resulting synthetic data. However, their performance depends heavily on the conditioning design: class prompts provide only coarse guidance, while domain adaptation modules mainly control appearance, which may leave target-style synthesis insufficiently specified. We propose VT-DUDA, a visual-token conditioning framework for diffusion-guided UDA. Instead of relying only on text prompts, VT-DUDA uses source images to provide additional instance-level visual context for target-style synthesis. Specifically, VT-DUDA maps each source image to a compact sequence of visual tokens and forms a hybrid conditioning context by concatenating these tokens with the corresponding text embeddings along the cross-attention context dimension of a latent diffusion model. This provides instance-dependent conditioning beyond text alone, while synthesis is performed with the target-domain adapter branch. Because guidance is represented explicitly as a token sequence, the same interface also permits inference-time manipulation of the conditioning signal through token selection and token-strength adjustment. The proposed method preserves the standard diffusion objective and can be integrated into existing adapter-based diffusion frameworks without modifying the backbone. Across Office-31, Office-Home, and VisDA-2017, VT-DUDA improves average target-domain accuracy over strong discriminative and diffusion-based UDA baselines. The results suggest that, in generation-based UDA, a stronger conditioning interface can improve the downstream usefulness of synthetic target-style data.

域适应扩散模型图像生成无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。