arXiv:2506.03521cs.CV2025-06AAAI被引 8

用文本语义空间找目标域共性,让跨域迁移更鲁棒。

Target Semantics Clustering via Text Representations for Robust Universal Domain Adaptation

  • 在离散文本空间中寻找语义中心,减少域偏移影响。
  • 在四个基准上实现当前最优性能,适应多种类别漂移场景。
  • 适合需要稳定跨域迁移的工业级应用,如医疗图像分析。

通用域适应(UniDA)旨在应对域偏移和未知类别偏移下的知识迁移挑战,核心难点在于识别共现类别样本并实现对齐。现有方法通常从无约束的连续图像表示空间中获取目标域语义中心,受域偏移和聚类数未知影响,导致中心复杂且对齐算法不稳定。本文基于视觉-语言模型,在语义有意义且离散的文本表示空间中搜索语义中心。该约束空间几乎无域偏差,且语义粒度合适,支持简单稳健的适配算法。我们提出基于文本表示的目标语义聚类(TASC),以信息最大化为统一目标,分两阶段:第一阶段使用冻结编码器与贪心搜索框架,找出最优文本嵌入集合以表征目标语义;第二阶段固定搜索结果,通过梯度下降优化编码器,同时实现鲁棒域对齐与私有类别聚类。此外,我们提出专用于UniDA中开集样本检测的通用最大相似度(UniMS)评分函数。在四种类别偏移场景下评估了多个基准上的通用性,实验表明本方法显著提升有效性与鲁棒性,达到当前最优表现。

原文摘要 · Abstract (English)

Universal Domain Adaptation (UniDA) focuses on transferring source domain knowledge to the target domain under both domain shift and unknown category shift. Its main challenge lies in identifying common class samples and aligning them. Current methods typically obtain target domain semantics centers from an unconstrained continuous image representation space. Due to domain shift and the unknown number of clusters, these centers often result in complex and less robust alignment algorithm. In this paper, based on vision-language models, we search for semantic centers in a semantically meaningful and discrete text representation space. The constrained space ensures almost no domain bias and appropriate semantic granularity for these centers, enabling a simple and robust adaptation algorithm. Specifically, we propose TArget Semantics Clustering (TASC) via Text Representations, which leverages information maximization as a unified objective and involves two stages. First, with the frozen encoders, a greedy search-based framework is used to search for an optimal set of text embeddings to represent target semantics. Second, with the search results fixed, encoders are refined based on gradient descent, simultaneously achieving robust domain alignment and private class clustering. Additionally, we propose Universal Maximum Similarity (UniMS), a scoring function tailored for detecting open-set samples in UniDA. Experimentally, we evaluate the universality of UniDA algorithms under four category shift scenarios. Extensive experiments on four benchmarks demonstrate the effectiveness and robustness of our method, which has achieved state-of-the-art performance.

域适应语义聚类视觉语言模型鲁棒迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。