arXiv:2605.03365cs.CV2026-05中稿 · the 28th Internati…

用两个基础模型提升无监督域适应,让分割更准更快。

Dual-Foundation Models for Unsupervised Domain Adaptation

  • 用SAM+超像素提示扩大目标域学习范围
  • 用DINOv3构建稳定不变的类别原型,提升精度
  • 适合自动驾驶等需要跨域分割的任务

语义分割为自动驾驶和细粒度感知任务提供像素级场景理解。然而,训练分割模型需在真实数据集上耗费大量人力进行标注。无监督域适应(UDA)通过在标注的合成数据上训练模型,并将其适配到未标注的真实图像上,缓解这一问题。尽管概念简单,但因合成与真实数据间的视觉外观和场景结构差异(即域差距),适配仍具挑战。先前方法依赖像素级混合或特征级对比学习来弥合差距,但存在两大局限:(1) 依赖高置信度伪标签,导致仅能学习目标域中部分像素;(2) 基于源域模型初始化类原型,造成适配过程中原型偏差且不稳定。为此,我们提出双基础模型的UDA框架,利用两个互补的基础模型:首先,采用分割任意模型(SAM)结合超像素引导提示,使模型能够从更广泛的目标域像素中学习,突破高置信度预测限制;其次,引入DINOv3通过其强大的表示学习能力,构建稳定、域不变的类别原型。该方法在GTA-to-Cityscapes和SYNTHIA-to-Cityscapes任务上分别相较强基线提升+1.3%和+1.4% mIoU。

原文摘要 · Abstract (English)

Semantic segmentation provides pixel-level scene understanding essential for autonomous driving and fine-grained perception tasks. However, training segmentation models requires costly, labor-intensive annotations on real-world datasets. Unsupervised Domain Adaptation (UDA) addresses this by training models on labeled synthetic data and adapting them to unlabeled real images. While conceptually simple, adaptation is challenging due to the domain gap, i.e., differences in visual appearance and scene structure between synthetic and real data. Prior approaches bridge this gap through pixel-level mixing or feature-level contrastive learning. Yet, these techniques suffer from two major limitations: (1) reliance on high-confidence pseudo-labels restricts learning to a subset of the target domain, and (2) prototype-based contrastive methods initialize class prototypes from source-trained models, yielding biased and unstable anchors during adaptation. To address these issues, we propose a dual-foundation UDA framework that leverages two complementary foundation models. First, we employ the Segment Anything Model (SAM) with superpixel-guided prompting to enable learning from a broader range of target pixels beyond high-confidence predictions. Second, we incorporate DINOv3 to construct stable, domain-invariant class prototypes through its robust representation learning. Our method achieves consistent improvements of +1.3% and +1.4% mIoU over strong UDA baselines on GTA-to-Cityscapes and SYNTHIA-to-Cityscapes, respectively.

无监督域适应语义分割基础模型域适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。